Jun 10 10:18:32.025197 ip-10-0-136-245 systemd[1]: Starting Kubernetes Kubelet...
Jun 10 10:18:32.423504 ip-10-0-136-245 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 10:18:32.423504 ip-10-0-136-245 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 10 10:18:32.423504 ip-10-0-136-245 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 10:18:32.423504 ip-10-0-136-245 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 10 10:18:32.423504 ip-10-0-136-245 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 10:18:32.425453 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.425356    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 10 10:18:32.431453 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431425    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 10:18:32.431453 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431448    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 10:18:32.431453 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431453    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 10:18:32.431453 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431457    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 10:18:32.431453 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431460    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 10:18:32.431453 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431463    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431466    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431469    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431472    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431475    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431478    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431482    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431485    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431487    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431490    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431493    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431496    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431499    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431502    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431505    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431507    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431510    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431513    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431515    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431518    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 10:18:32.431701 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431520    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431523    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431526    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431528    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431531    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431533    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431536    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431539    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431543    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431548    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431551    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431554    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431557    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431561    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431566    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431569    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431573    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431576    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431579    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 10:18:32.432195 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431582    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431585    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431588    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431590    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431593    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431596    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431599    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431601    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431606    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431608    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431611    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431614    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431617    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431620    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431624    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431627    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431630    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431632    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431635    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431638    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 10:18:32.432700 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431640    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431643    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431645    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431648    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431652    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431654    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431657    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431661    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431664    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431667    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431670    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431672    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431675    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431678    2552 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431680    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431683    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431685    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431688    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431691    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 10:18:32.433251 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431694    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431697    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431699    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431702    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431704    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431707    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431710    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431712    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431715    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431717    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431720    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431723    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431725    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431728    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431730    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.431732    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432504    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432512    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432515    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432518    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 10:18:32.433713 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432522    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432525    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432528    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432531    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432533    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432536    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432539    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432543    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432546    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432550    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432554    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432557    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432560    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432564    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432568    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432571    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432574    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432576    2552 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432579    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432581    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 10:18:32.434214 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432584    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432586    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432589    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432592    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432594    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432597    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432599    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432602    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432604    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432607    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432611    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432615    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432619    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432622    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432625    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432629    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432632    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432635    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432637    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 10:18:32.434723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432641    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432643    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432646    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432649    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432651    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432654    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432657    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432662    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432664    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432667    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432670    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432672    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432675    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432677    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432680    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432683    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432686    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432688    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432691    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 10:18:32.435213 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432693    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432696    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432698    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432701    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432704    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432707    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432711    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432714    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432718    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432721    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432724    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432727    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432729    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432732    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432734    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432737    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432739    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432742    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432744    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 10:18:32.435723 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432747    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432750    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432754    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432757    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432759    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432762    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432765    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432767    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432770    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432772    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432775    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432777    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432780    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432782    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432785    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432787    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432790    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.432792    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433213    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433218    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 10:18:32.436209 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433221    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433225    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433227    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433230    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433233    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433236    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433239    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433242    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433245    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433248    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433252    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433255    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433257    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433260    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433264    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433267    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433269    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433272    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433274    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433277    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 10:18:32.436707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433280    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433283    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433285    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433288    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433290    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433293    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433295    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433298    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433301    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433303    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433306    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433310    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433312    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433315    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433317    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433320    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433323    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433325    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433328    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433330    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 10:18:32.437212 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433333    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433335    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433339    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433342    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433345    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433348    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433350    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433354    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433356    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433359    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433362    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433365    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433367    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433371    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433375    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433378    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433383    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433386    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433389    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 10:18:32.437688 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433391    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433394    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433396    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433399    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433401    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433404    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433407    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433410    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433412    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433415    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433418    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433420    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433423    2552 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433425    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433428    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433430    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433432    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433435    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433437    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433442    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 10:18:32.438176 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433444    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433447    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433450    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433452    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433455    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433458    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433460    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433463    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433466    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433469    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433473    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433476    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433479    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433482    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433485    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433487    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433490    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.433493    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433570    2552 flags.go:64] FLAG: --address="0.0.0.0"
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433578    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 10 10:18:32.438674 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433587    2552 flags.go:64] FLAG: --anonymous-auth="true"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433594    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433600    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433605    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433612    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433618    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433621    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433624    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433628    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433631    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433636    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433639    2552 flags.go:64] FLAG: --cgroup-root=""
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433642    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433645    2552 flags.go:64] FLAG: --client-ca-file=""
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433648    2552 flags.go:64] FLAG: --cloud-provider="external"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433651    2552 flags.go:64] FLAG: --cluster-dns="[]"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433657    2552 flags.go:64] FLAG: --cluster-domain=""
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433659    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433662    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433666    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433672    2552 flags.go:64] FLAG: --container-log-max-files="5"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433682    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433685    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 10 10:18:32.439176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433688    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433692    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433695    2552 flags.go:64] FLAG: --contention-profiling="false"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433698    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433701    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433704    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433707    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433711    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433715    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433718    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433721    2552 flags.go:64] FLAG: --enable-load-reader="false"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433725    2552 flags.go:64] FLAG: --enable-server="true"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433728    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433733    2552 flags.go:64] FLAG: --event-burst="100"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433736    2552 flags.go:64] FLAG: --event-qps="50"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433739    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433742    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433745    2552 flags.go:64] FLAG: --eviction-hard=""
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433749    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433752    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433755    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433758    2552 flags.go:64] FLAG: --eviction-soft=""
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433761    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433764    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433767    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 10 10:18:32.439729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433770    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433773    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433776    2552 flags.go:64] FLAG: --fail-swap-on="true"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433779    2552 flags.go:64] FLAG: --feature-gates=""
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433785    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433788    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433791    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433794    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433797    2552 flags.go:64] FLAG: --healthz-port="10248"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433801    2552 flags.go:64] FLAG: --help="false"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433804    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433808    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433810    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433813    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433817    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433820    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433823    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433826    2552 flags.go:64] FLAG: --image-service-endpoint=""
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433829    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433832    2552 flags.go:64] FLAG: --kube-api-burst="100"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433835    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433838    2552 flags.go:64] FLAG: --kube-api-qps="50"
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433841    2552 flags.go:64] FLAG: --kube-reserved=""
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433843    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 10 10:18:32.440369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433846    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433849    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433852    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433855    2552 flags.go:64] FLAG: --lock-file=""
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433858    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433860    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433863    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433869    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433877    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433881    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433883    2552 flags.go:64] FLAG: --logging-format="text"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433886    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433891    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433897    2552 flags.go:64] FLAG: --manifest-url=""
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433900    2552 flags.go:64] FLAG: --manifest-url-header=""
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433917    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433920    2552 flags.go:64] FLAG: --max-open-files="1000000"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433925    2552 flags.go:64] FLAG: --max-pods="110"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433928    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433931    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433934    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433937    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433940    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433943    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433946    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 10 10:18:32.440973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433954    2552 flags.go:64] FLAG: --node-status-max-images="50"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433957    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433960    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433963    2552 flags.go:64] FLAG: --pod-cidr=""
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433966    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433972    2552 flags.go:64] FLAG: --pod-manifest-path=""
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433975    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433978    2552 flags.go:64] FLAG: --pods-per-core="0"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433981    2552 flags.go:64] FLAG: --port="10250"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433984    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433987    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0041920e68dac19de"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433991    2552 flags.go:64] FLAG: --qos-reserved=""
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433994    2552 flags.go:64] FLAG: --read-only-port="10255"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.433997    2552 flags.go:64] FLAG: --register-node="true"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434000    2552 flags.go:64] FLAG: --register-with-taints=""
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434004    2552 flags.go:64] FLAG: --registry-burst="10"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434013    2552 flags.go:64] FLAG: --registry-qps="5"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434016    2552 flags.go:64] FLAG: --reserved-cpus=""
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434019    2552 flags.go:64] FLAG: --reserved-memory=""
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434024    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434027    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434031    2552 flags.go:64] FLAG: --rotate-certificates="false"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434034    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434037    2552 flags.go:64] FLAG: --runonce="false"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434040    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 10 10:18:32.441602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434043    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434046    2552 flags.go:64] FLAG: --seccomp-default="false"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434049    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434052    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434055    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434058    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434061    2552 flags.go:64] FLAG: --storage-driver-password="root"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434064    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434067    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434070    2552 flags.go:64] FLAG: --storage-driver-user="root"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434073    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434076    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434079    2552 flags.go:64] FLAG: --system-cgroups=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434082    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434088    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434090    2552 flags.go:64] FLAG: --tls-cert-file=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434093    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434101    2552 flags.go:64] FLAG: --tls-min-version=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434104    2552 flags.go:64] FLAG: --tls-private-key-file=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434107    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434113    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434116    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434119    2552 flags.go:64] FLAG: --v="2"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434123    2552 flags.go:64] FLAG: --version="false"
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434128    2552 flags.go:64] FLAG: --vmodule=""
Jun 10 10:18:32.442245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434132    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.434136    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434295    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434301    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434304    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434307    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434310    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434313    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434316    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434319    2552 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434322    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434325    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434328    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434331    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434333    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434337    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434339    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434343    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434348    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434351    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 10:18:32.442888 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434354    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434357    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434360    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434362    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434365    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434368    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434370    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434373    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434375    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434378    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434381    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434383    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434387    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434391    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434394    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434398    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434400    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434403    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434406    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 10:18:32.443459 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434409    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434411    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434414    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434417    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434419    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434422    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434425    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434427    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434430    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434432    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434435    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434438    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434440    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434443    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434446    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434448    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434451    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434454    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434457    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434459    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 10:18:32.443935 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434462    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434465    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434467    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434470    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434472    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434475    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434479    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434482    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434487    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434490    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434492    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434495    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434498    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434500    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434503    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434505    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434508    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434510    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434513    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434516    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 10:18:32.444452 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434518    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434521    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434524    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434526    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434529    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434532    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434534    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434537    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434540    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434544    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434547    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434550    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434553    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434556    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434558    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434561    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434563    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434566    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434570    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434573    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 10:18:32.444960 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434577    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.434581    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.435469    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.442233    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.442254    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.442926    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.442938    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443022    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443028    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443032    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443036    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443039    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443042    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443045    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 10:18:32.445449 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443048    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443052    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443054    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443057    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443060    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443062    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443065    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443068    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443072    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443076    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443080    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443083    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443086    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443090    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443092    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443095    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443098    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443107    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 10:18:32.445848 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443110    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443112    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443115    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443117    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443121    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443124    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443127    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443129    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443133    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443136    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443139    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443141    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443144    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443146    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443149    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443152    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443154    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443157    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443160    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443162    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 10:18:32.446329 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443165    2552 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443168    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443170    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443173    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443175    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443178    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443180    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443183    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443186    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443188    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443191    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443193    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443202    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443204    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443207    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443210    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443213    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443216    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443219    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443222    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 10:18:32.446816 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443224    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443227    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443230    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443232    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443235    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443238    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443240    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443243    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443246    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443248    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443251    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443253    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443256    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443258    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443261    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443264    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443266    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443269    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443271    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443274    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 10:18:32.447330 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443277    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443279    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443282    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443284    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443287    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443295    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443298    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443301    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443304    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443307    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443311    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443315    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443318    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443320    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 10:18:32.447825 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.443326    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443472    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443477    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443480    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443483    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443486    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443489    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443492    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443494    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443497    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443499    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443502    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443505    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443508    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443510    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443513    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443515    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443518    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443521    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443523    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 10:18:32.448186 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443526    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443528    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443531    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443533    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443543    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443546    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443548    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443552    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443555    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443557    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443560    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443563    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443565    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443568    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443570    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443573    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443576    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443578    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443581    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443583    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 10:18:32.448673 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443586    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443588    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443591    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443594    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443596    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443599    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443601    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443604    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443606    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443609    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443611    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443614    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443616    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443619    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443622    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443624    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443627    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443636    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443639    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 10:18:32.449268 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443642    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443644    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443647    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443650    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443653    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443655    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443658    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443660    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443663    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443665    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443668    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443671    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443674    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443677    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443680    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443683    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443685    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443688    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443690    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443692    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 10:18:32.449733 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443695    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443697    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443700    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443702    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443705    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443707    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443710    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443713    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443715    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443717    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443720    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443729    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443733    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443737    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443740    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443743    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443746    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443749    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443753    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 10:18:32.450224 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443756    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:32.443759    2552 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.443765    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.443918    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.447228    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.448639    2552 server.go:1019] "Starting client certificate rotation"
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.448750    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 10:18:32.450693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.448802    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 10:18:32.451381 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.451367    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 10:18:32.457767 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.457600    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 10:18:32.466748 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.466726    2552 log.go:25] "Validated CRI v1 runtime API"
Jun 10 10:18:32.469471 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.469454    2552 log.go:25] "Validated CRI v1 image API"
Jun 10 10:18:32.471391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.471375    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 10 10:18:32.473843 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.473816    2552 fs.go:135] Filesystem UUIDs: map[4a0b4ca5-c5eb-493c-94ce-d22fa94a9726:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 acb60d1b-3542-4afc-8fe1-11ac3e039e92:/dev/nvme0n1p4]
Jun 10 10:18:32.473929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.473842    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 10 10:18:32.478997 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.478863    2552 manager.go:216] Machine: {Timestamp:2026-06-10 10:18:32.477605553 +0000 UTC m=+0.334541975 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099664 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2702dfffe8136932035ee5ceac4134 SystemUUID:ec2702df-ffe8-1369-3203-5ee5ceac4134 BootID:32f2709b-37f7-4c1c-acf2-e2fee21c76ef Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:54:88:e6:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:54:88:e6:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:3c:0a:da:fe:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 10 10:18:32.478997 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.478991    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 10 10:18:32.479192 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.479078    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 10 10:18:32.481235 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.481200    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 10 10:18:32.481407 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.481237    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 10 10:18:32.482556 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.482544    2552 topology_manager.go:138] "Creating topology manager with none policy"
Jun 10 10:18:32.482599 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.482558    2552 container_manager_linux.go:309] "Creating device plugin manager"
Jun 10 10:18:32.482599 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.482566    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 10:18:32.483229 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.483218    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 10:18:32.483452 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.483434    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 10:18:32.483974 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.483963    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 10 10:18:32.486653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486637    2552 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 10:18:32.486812 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486800    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 10 10:18:32.486867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486840    2552 kubelet.go:486] "Attempting to sync node with API server"
Jun 10 10:18:32.486867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486863    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 10 10:18:32.486975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486884    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 10 10:18:32.486975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486899    2552 kubelet.go:398] "Adding apiserver pod source"
Jun 10 10:18:32.486975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.486930    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 10 10:18:32.487396 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.487381    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 10:18:32.487512 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.487407    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 10:18:32.489833 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.489809    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 10 10:18:32.491167 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.491154    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 10 10:18:32.491233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.491184    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 10 10:18:32.492570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492545    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 10 10:18:32.492656 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492607    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 10 10:18:32.492656 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492617    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 10 10:18:32.492656 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492626    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492659    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492669    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492682    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492690    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492702    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492711    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492725    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 10 10:18:32.492794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.492734    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 10 10:18:32.493548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.493532    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 10 10:18:32.493592 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.493561    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 10 10:18:32.497172 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.497157    2552 server.go:1268] "Started kubelet"
Jun 10 10:18:32.497303 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.497271    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 10 10:18:32.497555 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.497251    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 10 10:18:32.497630 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.497571    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 10 10:18:32.498126 ip-10-0-136-245 systemd[1]: Started Kubernetes Kubelet.
Jun 10 10:18:32.498753 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.498361    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 10 10:18:32.498753 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.498359    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 10 10:18:32.498753 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.498450    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 10 10:18:32.499721 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.499697    2552 server.go:310] "Adding debug handlers to kubelet server"
Jun 10 10:18:32.499879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.499864    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 10 10:18:32.504345 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.504322    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 10 10:18:32.504419 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.504403    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 10 10:18:32.504496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.504403    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 10 10:18:32.504590 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.504503    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:32.505404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.505384    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 10 10:18:32.505528 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.505419    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 10 10:18:32.505623 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.505610    2552 reconstruct.go:97] "Volume reconstruction finished"
Jun 10 10:18:32.505623 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.505623    2552 reconciler.go:29] "Reconciler: start to sync state"
Jun 10 10:18:32.506045 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506028    2552 factory.go:55] Registering systemd factory
Jun 10 10:18:32.506138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506092    2552 factory.go:223] Registration of the systemd container factory successfully
Jun 10 10:18:32.506452 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.503784    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-245.ec2.internal.18b7b0edac8f3d3b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-245.ec2.internal,UID:ip-10-0-136-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-245.ec2.internal,},FirstTimestamp:2026-06-10 10:18:32.497126715 +0000 UTC m=+0.354063394,LastTimestamp:2026-06-10 10:18:32.497126715 +0000 UTC m=+0.354063394,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-245.ec2.internal,}"
Jun 10 10:18:32.506545 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506454    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 10 10:18:32.506653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506635    2552 factory.go:153] Registering CRI-O factory
Jun 10 10:18:32.506721 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506658    2552 factory.go:223] Registration of the crio container factory successfully
Jun 10 10:18:32.506721 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506713    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 10 10:18:32.506812 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506738    2552 factory.go:103] Registering Raw factory
Jun 10 10:18:32.506812 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.506753    2552 manager.go:1196] Started watching for new ooms in manager
Jun 10 10:18:32.507179 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.507162    2552 manager.go:349] Starting recovery of all containers
Jun 10 10:18:32.519630 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.519595    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xxj7d"
Jun 10 10:18:32.519762 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.519726    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 10 10:18:32.519898 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.519869    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 10 10:18:32.520225 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.520207    2552 manager.go:354] Recovery completed
Jun 10 10:18:32.521663 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.521644    2552 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jun 10 10:18:32.524625 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.524611    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.526531 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.526514    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.526605 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.526548    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.526605 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.526559    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.527255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.527238    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 10 10:18:32.527255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.527254    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 10 10:18:32.527354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.527258    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.527354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.527271    2552 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 10:18:32.528047 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.528029    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.528119 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.528056    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.528119 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.528067    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.528504 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.528491    2552 policy_none.go:49] "None policy: Start"
Jun 10 10:18:32.528540 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.528509    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 10 10:18:32.528540 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.528520    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 10 10:18:32.529223 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.529204    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xxj7d"
Jun 10 10:18:32.529307 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.529215    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-245.ec2.internal.18b7b0edae4fef6b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-245.ec2.internal,UID:ip-10-0-136-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-245.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-245.ec2.internal,},FirstTimestamp:2026-06-10 10:18:32.526532459 +0000 UTC m=+0.383468883,LastTimestamp:2026-06-10 10:18:32.526532459 +0000 UTC m=+0.383468883,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-245.ec2.internal,}"
Jun 10 10:18:32.529788 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.529775    2552 policy_none.go:47] "Start"
Jun 10 10:18:32.566645 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.566621    2552 manager.go:337] "Starting Device Plugin manager"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.566657    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.566668    2552 server.go:87] "Starting device plugin registration server"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.567000    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.567014    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.567132    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.567253    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.567262    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.567767    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.567806    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.572564    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.573749    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.573788    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.573810    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 10 10:18:32.574736 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.573841    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 10 10:18:32.576219 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.576196    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 10:18:32.667179 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.667158    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.668583 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.668565    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.668732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.668595    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.668732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.668604    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.668732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.668628    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.674819 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.674762    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"]
Jun 10 10:18:32.674887 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.674834    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.676255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.676240    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.676348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.676268    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.676348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.676280    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.677636 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.677623    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.677759 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.677744    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.677813 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.677776    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.678400 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.678383    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.678476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.678415    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.678476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.678426    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.678476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.678391    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.678614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.678485    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.678614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.678501    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.679614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.679599    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.679693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.679625    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 10:18:32.680306 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.680290    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 10:18:32.680388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.680321    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 10:18:32.680388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.680335    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID"
Jun 10 10:18:32.685692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.685679    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.685752 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.685700    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-245.ec2.internal\": node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:32.706842 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.706820    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.711655 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.711637    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.724268 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.724243    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:32.806768 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.806737    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c669b69a13ee0553f96203e0165f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"f3c669b69a13ee0553f96203e0165f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.806944 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.806777    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c669b69a13ee0553f96203e0165f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"f3c669b69a13ee0553f96203e0165f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.806944 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.806797    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0cfd7fd91bf7b2135b4a972f86e20b51-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"0cfd7fd91bf7b2135b4a972f86e20b51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.825201 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.825178    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:32.907199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.907166    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c669b69a13ee0553f96203e0165f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"f3c669b69a13ee0553f96203e0165f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.907199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.907202    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c669b69a13ee0553f96203e0165f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"f3c669b69a13ee0553f96203e0165f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.907391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.907221    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0cfd7fd91bf7b2135b4a972f86e20b51-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"0cfd7fd91bf7b2135b4a972f86e20b51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.907391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.907270    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0cfd7fd91bf7b2135b4a972f86e20b51-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"0cfd7fd91bf7b2135b4a972f86e20b51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.907391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.907272    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c669b69a13ee0553f96203e0165f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"f3c669b69a13ee0553f96203e0165f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.907391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:32.907282    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c669b69a13ee0553f96203e0165f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"f3c669b69a13ee0553f96203e0165f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:32.925950 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:32.925870    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.010720 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.010671    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:33.015533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.015515    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:33.026216 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.026194    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.126795 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.126749    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.227409 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.227339    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.327981 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.327944    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.428665 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.428627    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.447810 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.447782    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 10 10:18:33.447975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.447962    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 10:18:33.473448 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.473413    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 10:18:33.501134 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:33.500883    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c669b69a13ee0553f96203e0165f26.slice/crio-1c91ec1f9d18f921ed74d5089eb02b3b1885fa9aa637df2576c557ee2b44f088 WatchSource:0}: Error finding container 1c91ec1f9d18f921ed74d5089eb02b3b1885fa9aa637df2576c557ee2b44f088: Status 404 returned error can't find the container with id 1c91ec1f9d18f921ed74d5089eb02b3b1885fa9aa637df2576c557ee2b44f088
Jun 10 10:18:33.501391 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:33.501364    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfd7fd91bf7b2135b4a972f86e20b51.slice/crio-621ff83d7f887b593d13f55e83f779e5c2f2185918de9e732fb6a6d4ad8e6e24 WatchSource:0}: Error finding container 621ff83d7f887b593d13f55e83f779e5c2f2185918de9e732fb6a6d4ad8e6e24: Status 404 returned error can't find the container with id 621ff83d7f887b593d13f55e83f779e5c2f2185918de9e732fb6a6d4ad8e6e24
Jun 10 10:18:33.506876 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.506859    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 10:18:33.528751 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.528721    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.528751 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.528749    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 10:18:33.532121 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.532099    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 10:13:32 +0000 UTC" deadline="2028-01-13 04:21:06.167501396 +0000 UTC"
Jun 10 10:18:33.532169 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.532123    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13962h2m32.635382706s"
Jun 10 10:18:33.577720 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.577662    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"f3c669b69a13ee0553f96203e0165f26","Type":"ContainerStarted","Data":"1c91ec1f9d18f921ed74d5089eb02b3b1885fa9aa637df2576c557ee2b44f088"}
Jun 10 10:18:33.578646 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.578621    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" event={"ID":"0cfd7fd91bf7b2135b4a972f86e20b51","Type":"ContainerStarted","Data":"621ff83d7f887b593d13f55e83f779e5c2f2185918de9e732fb6a6d4ad8e6e24"}
Jun 10 10:18:33.629259 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.629223    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.729840 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.729797    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.830452 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.830385    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.931015 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:33.930977    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found"
Jun 10 10:18:33.972158 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:33.972131    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 10:18:34.005638 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.005601    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:34.021126 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.021086    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 10:18:34.022257 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.022228    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"
Jun 10 10:18:34.040402 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.040377    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 10:18:34.339027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.338998    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 10:18:34.487926 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.487886    2552 apiserver.go:52] "Watching apiserver"
Jun 10 10:18:34.497836 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.497804    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 10 10:18:34.498810 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.498786    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal","openshift-dns/node-resolver-hdhd4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal","openshift-multus/multus-additional-cni-plugins-hlsr6","openshift-multus/multus-dxvnf","openshift-multus/network-metrics-daemon-fznl8","openshift-network-operator/iptables-alerter-6qdrg","kube-system/global-pull-secret-syncer-cs4zm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm","openshift-cluster-node-tuning-operator/tuned-7grqz","openshift-image-registry/node-ca-ssp29","openshift-network-diagnostics/network-check-target-jcnpv","openshift-ovn-kubernetes/ovnkube-node-m6lbv","kube-system/konnectivity-agent-plv8g"]
Jun 10 10:18:34.500295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.500276    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.501412 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.501387    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.502391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.502373    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.503606 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.503586    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.504937 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.504816    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.504937 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.504874    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.505397 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.505092    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 10 10:18:34.505963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.505945    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:34.506052 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.506022    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:34.506568 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.506538    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tgptz\""
Jun 10 10:18:34.506734 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.506716    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 10 10:18:34.506785 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.506741    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.507434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.507412    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 10 10:18:34.507434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.507427    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7hw2r\""
Jun 10 10:18:34.507578 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.507459    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 10 10:18:34.507633 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.507583    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.507633 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.507624    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7zdnc\""
Jun 10 10:18:34.508456 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.508402    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.508551 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.508463    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:34.510925 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.510453    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.512581 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.512553    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.513669 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.513646    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 10 10:18:34.513669 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.513664    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 10 10:18:34.514031 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.513825    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.514031 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.513919    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 10 10:18:34.514031 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.514006    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.514214 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.514038    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 10 10:18:34.514214 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.514131    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.514675 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.514656    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.514975    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.514987    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515020    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.515044    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515066    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515023    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-62rq7\""
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515067    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 10 10:18:34.515232 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515151    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96j78\""
Jun 10 10:18:34.515608 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515383    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.515608 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515574    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f6b7j\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515744    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.515812    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516054    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cjhq5\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516106    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516056    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516161    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516279    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516293    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516555    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-etc-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516583    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-log-socket\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516602    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516618    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-socket-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516634    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-system-cni-dir\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516674    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-cnibin\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-hostroot\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.516709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516708    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-cni-bin\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h575x\" (UniqueName: \"kubernetes.io/projected/31c92604-74da-4bef-9801-ac3c0a9d26af-kube-api-access-h575x\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516783    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516810    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-systemd-units\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516831    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-node-log\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516875    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-sys-fs\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516928    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef905838-a1f0-4025-a1cb-279428c11747-cni-binary-copy\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7l8n\" (UniqueName: \"kubernetes.io/projected/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-kube-api-access-w7l8n\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.516987    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2cn7\" (UniqueName: \"kubernetes.io/projected/76422cdb-4abe-4de3-a33f-49aafeeaa38c-kube-api-access-p2cn7\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517025    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-cni-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517069    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-kubelet\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517134    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-conf-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517165    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef905838-a1f0-4025-a1cb-279428c11747-multus-daemon-config\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517192    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-ovn\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517215    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517238    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-etc-selinux\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.517494 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-k8s-cni-cncf-io\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517351    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-netns\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517374    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-cni-multus\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517422    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnv76\" (UniqueName: \"kubernetes.io/projected/ef905838-a1f0-4025-a1cb-279428c11747-kube-api-access-jnv76\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517448    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-kubelet\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517471    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517511    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a399149-f72c-48c1-8424-e31668063ce5-iptables-alerter-script\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517535    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0129c785-2601-4ed8-832d-abe84428173b-agent-certs\") pod \"konnectivity-agent-plv8g\" (UID: \"0129c785-2601-4ed8-832d-abe84428173b\") " pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517556    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-os-release\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517579    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-cni-bin\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517604    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-run-netns\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517631    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-systemd\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517653    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-env-overrides\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517677    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovn-node-metrics-cert\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517703    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovnkube-script-lib\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517732    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvp6l\" (UniqueName: \"kubernetes.io/projected/5a399149-f72c-48c1-8424-e31668063ce5-kube-api-access-lvp6l\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.518233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517757    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-system-cni-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517779    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-registration-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517804    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517838    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-os-release\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517899    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-socket-dir-parent\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-var-lib-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.517982    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518010    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-cni-netd\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518035    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518061    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-cnibin\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518086    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqk8j\" (UniqueName: \"kubernetes.io/projected/68f9c259-4579-47c8-a89d-c24fc5e6d461-kube-api-access-mqk8j\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518117    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-device-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518140    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0129c785-2601-4ed8-832d-abe84428173b-konnectivity-ca\") pod \"konnectivity-agent-plv8g\" (UID: \"0129c785-2601-4ed8-832d-abe84428173b\") " pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518164    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovnkube-config\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518194    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-multus-certs\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518217    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a399149-f72c-48c1-8424-e31668063ce5-host-slash\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.518870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518253    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-slash\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.519459 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518293    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.519459 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518317    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.519459 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.518342    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-etc-kubernetes\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.524569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.524332    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sh75s\""
Jun 10 10:18:34.524877 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.524859    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 10 10:18:34.525317 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.525302    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ffh5k\""
Jun 10 10:18:34.525552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.525536    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 10 10:18:34.525967 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.525948    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 10 10:18:34.535350 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.535322    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 10:18:34.586880 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.586848    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5whxb"
Jun 10 10:18:34.596324 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.596246    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5whxb"
Jun 10 10:18:34.607984 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.607955    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 10 10:18:34.619399 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619363    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-etc-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.619566 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619406    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-log-socket\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.619566 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619433    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.619566 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619457    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-socket-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.619566 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619480    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-system-cni-dir\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619570    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-cnibin\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619591    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-hostroot\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619613    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-cni-bin\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619620    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-socket-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619636    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h575x\" (UniqueName: \"kubernetes.io/projected/31c92604-74da-4bef-9801-ac3c0a9d26af-kube-api-access-h575x\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619493    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-log-socket\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619493    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-etc-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619531    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-system-cni-dir\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619533    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619673    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619676    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-hostroot\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619675    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-cnibin\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.619713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619710    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-cni-bin\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619745    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysctl-conf\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619777    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-systemd-units\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619885    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-systemd-units\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619895    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-node-log\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619953    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-sys-fs\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619970    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef905838-a1f0-4025-a1cb-279428c11747-cni-binary-copy\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.619983    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-node-log\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620008    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d767806-21d0-4933-bb3f-3671141887ef-tmp-dir\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620038    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-sys-fs\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620057    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-systemd\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620084    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7l8n\" (UniqueName: \"kubernetes.io/projected/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-kube-api-access-w7l8n\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620109    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2cn7\" (UniqueName: \"kubernetes.io/projected/76422cdb-4abe-4de3-a33f-49aafeeaa38c-kube-api-access-p2cn7\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620178    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-cni-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620211    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-kubelet\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620234    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-conf-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.620233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620240    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-cni-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620262    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef905838-a1f0-4025-a1cb-279428c11747-multus-daemon-config\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620283    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-conf-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620295    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620325    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6jfx\" (UniqueName: \"kubernetes.io/projected/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-kube-api-access-f6jfx\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620350    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-ovn\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620396    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620403    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-ovn\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620421    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-etc-selinux\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620282    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-kubelet\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620349    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620489    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-etc-selinux\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.620499    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620521    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-k8s-cni-cncf-io\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620545    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-netns\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.620565    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:18:35.120544895 +0000 UTC m=+2.977481322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620582    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-netns\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620594    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-cni-multus\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620617    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-k8s-cni-cncf-io\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620625    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-cni-multus\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620632    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef905838-a1f0-4025-a1cb-279428c11747-cni-binary-copy\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620622    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnv76\" (UniqueName: \"kubernetes.io/projected/ef905838-a1f0-4025-a1cb-279428c11747-kube-api-access-jnv76\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620699    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-tuned\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621161    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-kubelet\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.620748    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef905838-a1f0-4025-a1cb-279428c11747-multus-daemon-config\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621337    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621401    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-kubelet\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621409    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a399149-f72c-48c1-8424-e31668063ce5-iptables-alerter-script\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621489    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0129c785-2601-4ed8-832d-abe84428173b-agent-certs\") pod \"konnectivity-agent-plv8g\" (UID: \"0129c785-2601-4ed8-832d-abe84428173b\") " pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621528    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-os-release\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621544    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621568    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-cni-bin\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621601    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621615    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-os-release\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.621865 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621668    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-var-lib-cni-bin\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621708    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-run-netns\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621736    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-host\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621785    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-run-netns\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621888    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-serviceca\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621938    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-systemd\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621955    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a399149-f72c-48c1-8424-e31668063ce5-iptables-alerter-script\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621936    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622000    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-systemd\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.621971    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-env-overrides\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622056    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovn-node-metrics-cert\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622088    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovnkube-script-lib\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622126    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ef86f68-d30d-4000-97d6-29d744549b05-kubelet-config\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622154    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-tmp\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622184    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9c4\" (UniqueName: \"kubernetes.io/projected/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-kube-api-access-xh9c4\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvp6l\" (UniqueName: \"kubernetes.io/projected/5a399149-f72c-48c1-8424-e31668063ce5-kube-api-access-lvp6l\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622249    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-system-cni-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.622652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622286    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-sys\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622313    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-registration-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622343    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622379    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-os-release\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622408    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-socket-dir-parent\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622411    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-env-overrides\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622438    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d767806-21d0-4933-bb3f-3671141887ef-hosts-file\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622479    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-modprobe-d\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622512    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-var-lib-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622534    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622557    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-cni-netd\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622576    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622599    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-cnibin\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622619    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ef86f68-d30d-4000-97d6-29d744549b05-dbus\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysconfig\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-host\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622715    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqk8j\" (UniqueName: \"kubernetes.io/projected/68f9c259-4579-47c8-a89d-c24fc5e6d461-kube-api-access-mqk8j\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.623413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622737    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzv7\" (UniqueName: \"kubernetes.io/projected/2d767806-21d0-4933-bb3f-3671141887ef-kube-api-access-zhzv7\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622756    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-lib-modules\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622765    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-os-release\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622781    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-device-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622803    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0129c785-2601-4ed8-832d-abe84428173b-konnectivity-ca\") pod \"konnectivity-agent-plv8g\" (UID: \"0129c785-2601-4ed8-832d-abe84428173b\") " pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622823    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-kubernetes\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622845    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovnkube-config\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622867    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-multus-certs\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysctl-d\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622888    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622929    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-run\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622936    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622963    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a399149-f72c-48c1-8424-e31668063ce5-host-slash\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622992    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-slash\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623009    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-system-cni-dir\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623026    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623222    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.624231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623228    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-host-run-multus-certs\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623288    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a399149-f72c-48c1-8424-e31668063ce5-host-slash\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623337    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-slash\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.622843    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-multus-socket-dir-parent\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623471    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0129c785-2601-4ed8-832d-abe84428173b-konnectivity-ca\") pod \"konnectivity-agent-plv8g\" (UID: \"0129c785-2601-4ed8-832d-abe84428173b\") " pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623517    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623551    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-etc-kubernetes\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623582    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-var-lib-kubelet\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623685    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68f9c259-4579-47c8-a89d-c24fc5e6d461-cnibin\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623837    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovnkube-config\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623928    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovnkube-script-lib\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.623941    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-device-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.624049    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-run-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.624052    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31c92604-74da-4bef-9801-ac3c0a9d26af-registration-dir\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.624097    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef905838-a1f0-4025-a1cb-279428c11747-etc-kubernetes\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.624134    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-host-cni-netd\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.624149    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-var-lib-openvswitch\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.624978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.624376    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68f9c259-4579-47c8-a89d-c24fc5e6d461-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.626867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.626829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-ovn-node-metrics-cert\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.627022 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.626969    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0129c785-2601-4ed8-832d-abe84428173b-agent-certs\") pod \"konnectivity-agent-plv8g\" (UID: \"0129c785-2601-4ed8-832d-abe84428173b\") " pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.645754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.645716    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnv76\" (UniqueName: \"kubernetes.io/projected/ef905838-a1f0-4025-a1cb-279428c11747-kube-api-access-jnv76\") pod \"multus-dxvnf\" (UID: \"ef905838-a1f0-4025-a1cb-279428c11747\") " pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.648231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.648200    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h575x\" (UniqueName: \"kubernetes.io/projected/31c92604-74da-4bef-9801-ac3c0a9d26af-kube-api-access-h575x\") pod \"aws-ebs-csi-driver-node-fxnqm\" (UID: \"31c92604-74da-4bef-9801-ac3c0a9d26af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.651387 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.651364    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7l8n\" (UniqueName: \"kubernetes.io/projected/2e30ff2c-3b5d-4515-b2a8-f60475fbf444-kube-api-access-w7l8n\") pod \"ovnkube-node-m6lbv\" (UID: \"2e30ff2c-3b5d-4515-b2a8-f60475fbf444\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.654787 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.654753    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2cn7\" (UniqueName: \"kubernetes.io/projected/76422cdb-4abe-4de3-a33f-49aafeeaa38c-kube-api-access-p2cn7\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:34.654920 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.654835    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqk8j\" (UniqueName: \"kubernetes.io/projected/68f9c259-4579-47c8-a89d-c24fc5e6d461-kube-api-access-mqk8j\") pod \"multus-additional-cni-plugins-hlsr6\" (UID: \"68f9c259-4579-47c8-a89d-c24fc5e6d461\") " pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.655718 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.655693    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvp6l\" (UniqueName: \"kubernetes.io/projected/5a399149-f72c-48c1-8424-e31668063ce5-kube-api-access-lvp6l\") pod \"iptables-alerter-6qdrg\" (UID: \"5a399149-f72c-48c1-8424-e31668063ce5\") " pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.724042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724004    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysctl-conf\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724052    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d767806-21d0-4933-bb3f-3671141887ef-tmp-dir\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724077    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-systemd\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724103    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724152    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6jfx\" (UniqueName: \"kubernetes.io/projected/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-kube-api-access-f6jfx\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724193    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-tuned\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724219    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.724231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724220    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysctl-conf\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724220    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-systemd\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724243    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-host\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724295    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-host\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.724342    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.724407    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:35.224386742 +0000 UTC m=+3.081323170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724426    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-serviceca\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724458    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ef86f68-d30d-4000-97d6-29d744549b05-kubelet-config\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724483    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-tmp\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724531    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9c4\" (UniqueName: \"kubernetes.io/projected/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-kube-api-access-xh9c4\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.724570 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724558    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-sys\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724569    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ef86f68-d30d-4000-97d6-29d744549b05-kubelet-config\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724588    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d767806-21d0-4933-bb3f-3671141887ef-hosts-file\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724623    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-modprobe-d\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724643    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d767806-21d0-4933-bb3f-3671141887ef-hosts-file\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724658    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ef86f68-d30d-4000-97d6-29d744549b05-dbus\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724664    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d767806-21d0-4933-bb3f-3671141887ef-tmp-dir\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724683    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysconfig\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724699    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-sys\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724707    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-host\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724732    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzv7\" (UniqueName: \"kubernetes.io/projected/2d767806-21d0-4933-bb3f-3671141887ef-kube-api-access-zhzv7\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724754    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-lib-modules\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724782    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-kubernetes\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724830    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysctl-d\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724833    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ef86f68-d30d-4000-97d6-29d744549b05-dbus\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724839    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-host\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724860    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-run\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724871    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-modprobe-d\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724877    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-serviceca\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724889    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-var-lib-kubelet\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724882    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysconfig\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724954    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-lib-modules\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724983    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-run\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724991    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-var-lib-kubelet\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.724998    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-sysctl-d\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.725736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.725040    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-kubernetes\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.726827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.726806    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-tmp\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.726949 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.726865    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-etc-tuned\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.734092 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.734064    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:18:34.734092 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.734096    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:18:34.734303 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.734111    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:34.734303 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:34.734177    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:35.234161538 +0000 UTC m=+3.091097946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:34.736854 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.736811    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh9c4\" (UniqueName: \"kubernetes.io/projected/5a4ec284-9d48-4a2e-9f6c-72dd62a729d4-kube-api-access-xh9c4\") pod \"node-ca-ssp29\" (UID: \"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4\") " pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.737099 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.737073    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6jfx\" (UniqueName: \"kubernetes.io/projected/a79b7c5e-a57c-4e89-8caa-d83c9c4a0095-kube-api-access-f6jfx\") pod \"tuned-7grqz\" (UID: \"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095\") " pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.743247 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.743218    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzv7\" (UniqueName: \"kubernetes.io/projected/2d767806-21d0-4933-bb3f-3671141887ef-kube-api-access-zhzv7\") pod \"node-resolver-hdhd4\" (UID: \"2d767806-21d0-4933-bb3f-3671141887ef\") " pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.814365 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.814342    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6qdrg"
Jun 10 10:18:34.821822 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.821798    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:18:34.822512 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.822487    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a399149_f72c_48c1_8424_e31668063ce5.slice/crio-9b9e0f66931e167f1593041d0bf689b9c38c88c8f37717a735078cad4ae4c7cb WatchSource:0}: Error finding container 9b9e0f66931e167f1593041d0bf689b9c38c88c8f37717a735078cad4ae4c7cb: Status 404 returned error can't find the container with id 9b9e0f66931e167f1593041d0bf689b9c38c88c8f37717a735078cad4ae4c7cb
Jun 10 10:18:34.828663 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.828644    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:34.829674 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.829651    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e30ff2c_3b5d_4515_b2a8_f60475fbf444.slice/crio-6e13385f7f5c375cf21d3cd95f3b67de106bd9767da8a6e8c9ecb8030956dc1a WatchSource:0}: Error finding container 6e13385f7f5c375cf21d3cd95f3b67de106bd9767da8a6e8c9ecb8030956dc1a: Status 404 returned error can't find the container with id 6e13385f7f5c375cf21d3cd95f3b67de106bd9767da8a6e8c9ecb8030956dc1a
Jun 10 10:18:34.835305 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.835281    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlsr6"
Jun 10 10:18:34.840736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.840718    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxvnf"
Jun 10 10:18:34.842977 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.842951    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9c259_4579_47c8_a89d_c24fc5e6d461.slice/crio-90639a7ff66a18bf6312d417045751eda7cc86aa2aff5a8487adbfc02d2b99b7 WatchSource:0}: Error finding container 90639a7ff66a18bf6312d417045751eda7cc86aa2aff5a8487adbfc02d2b99b7: Status 404 returned error can't find the container with id 90639a7ff66a18bf6312d417045751eda7cc86aa2aff5a8487adbfc02d2b99b7
Jun 10 10:18:34.847971 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.847952    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm"
Jun 10 10:18:34.848423 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.848347    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef905838_a1f0_4025_a1cb_279428c11747.slice/crio-1f13823c492ab93c6e579665fccebc22cd0c90ed6e51e902b918e8aa57a9df33 WatchSource:0}: Error finding container 1f13823c492ab93c6e579665fccebc22cd0c90ed6e51e902b918e8aa57a9df33: Status 404 returned error can't find the container with id 1f13823c492ab93c6e579665fccebc22cd0c90ed6e51e902b918e8aa57a9df33
Jun 10 10:18:34.854397 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.854187    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hdhd4"
Jun 10 10:18:34.859569 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.859540    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c92604_74da_4bef_9801_ac3c0a9d26af.slice/crio-59f9d67150a6f275458a51416de279339acd89dd9ad1460f16f2941b7be59e43 WatchSource:0}: Error finding container 59f9d67150a6f275458a51416de279339acd89dd9ad1460f16f2941b7be59e43: Status 404 returned error can't find the container with id 59f9d67150a6f275458a51416de279339acd89dd9ad1460f16f2941b7be59e43
Jun 10 10:18:34.860687 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.860667    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7grqz"
Jun 10 10:18:34.862197 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.862169    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d767806_21d0_4933_bb3f_3671141887ef.slice/crio-e9a22c1a356d1666897dfb97c7013209fc6bd6f64b4e05116340a069549db903 WatchSource:0}: Error finding container e9a22c1a356d1666897dfb97c7013209fc6bd6f64b4e05116340a069549db903: Status 404 returned error can't find the container with id e9a22c1a356d1666897dfb97c7013209fc6bd6f64b4e05116340a069549db903
Jun 10 10:18:34.865741 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:34.865728    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ssp29"
Jun 10 10:18:34.868335 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.868312    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79b7c5e_a57c_4e89_8caa_d83c9c4a0095.slice/crio-029ac30d5316e4e2b73240e39930812ef26f5f62ca3ec0692860d53b30a40b2b WatchSource:0}: Error finding container 029ac30d5316e4e2b73240e39930812ef26f5f62ca3ec0692860d53b30a40b2b: Status 404 returned error can't find the container with id 029ac30d5316e4e2b73240e39930812ef26f5f62ca3ec0692860d53b30a40b2b
Jun 10 10:18:34.873333 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:18:34.873313    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4ec284_9d48_4a2e_9f6c_72dd62a729d4.slice/crio-031578dc637154d84fcba50e577ebe9ed87f63ad99fdf276c6ee1dcff4bb68de WatchSource:0}: Error finding container 031578dc637154d84fcba50e577ebe9ed87f63ad99fdf276c6ee1dcff4bb68de: Status 404 returned error can't find the container with id 031578dc637154d84fcba50e577ebe9ed87f63ad99fdf276c6ee1dcff4bb68de
Jun 10 10:18:35.127983 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.127949    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:35.128150 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.128127    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:35.128227 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.128215    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:18:36.128193157 +0000 UTC m=+3.985129582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:35.228760 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.228717    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:35.228948 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.228871    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:35.229017 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.228953    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:36.22893559 +0000 UTC m=+4.085872002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:35.329165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.329127    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:35.329372 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.329352    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:18:35.329450 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.329380    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:18:35.329450 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.329394    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:35.329636 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.329455    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:36.329436314 +0000 UTC m=+4.186372725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:35.576250 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.576157    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:35.576740 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:35.576287    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:35.598592 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.598530    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 10:13:34 +0000 UTC" deadline="2028-02-21 15:19:19.257077218 +0000 UTC"
Jun 10 10:18:35.598592 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.598585    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14909h0m43.658495858s"
Jun 10 10:18:35.601342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.601317    2552 generic.go:356] "Generic (PLEG): container finished" podID="f3c669b69a13ee0553f96203e0165f26" containerID="a99e6cd4efa89d94210aefaf55669172871c3f7f3293a6f4ca1a0edf41a0f0b3" exitCode=0
Jun 10 10:18:35.601663 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.601593    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"f3c669b69a13ee0553f96203e0165f26","Type":"ContainerDied","Data":"a99e6cd4efa89d94210aefaf55669172871c3f7f3293a6f4ca1a0edf41a0f0b3"}
Jun 10 10:18:35.617730 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.617695    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ssp29" event={"ID":"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4","Type":"ContainerStarted","Data":"031578dc637154d84fcba50e577ebe9ed87f63ad99fdf276c6ee1dcff4bb68de"}
Jun 10 10:18:35.640996 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.640956    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7grqz" event={"ID":"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095","Type":"ContainerStarted","Data":"029ac30d5316e4e2b73240e39930812ef26f5f62ca3ec0692860d53b30a40b2b"}
Jun 10 10:18:35.653623 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.653591    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hdhd4" event={"ID":"2d767806-21d0-4933-bb3f-3671141887ef","Type":"ContainerStarted","Data":"e9a22c1a356d1666897dfb97c7013209fc6bd6f64b4e05116340a069549db903"}
Jun 10 10:18:35.681526 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.681257    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxvnf" event={"ID":"ef905838-a1f0-4025-a1cb-279428c11747","Type":"ContainerStarted","Data":"1f13823c492ab93c6e579665fccebc22cd0c90ed6e51e902b918e8aa57a9df33"}
Jun 10 10:18:35.697383 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.697348    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerStarted","Data":"90639a7ff66a18bf6312d417045751eda7cc86aa2aff5a8487adbfc02d2b99b7"}
Jun 10 10:18:35.707189 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.707155    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"6e13385f7f5c375cf21d3cd95f3b67de106bd9767da8a6e8c9ecb8030956dc1a"}
Jun 10 10:18:35.719006 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.718896    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm" event={"ID":"31c92604-74da-4bef-9801-ac3c0a9d26af","Type":"ContainerStarted","Data":"59f9d67150a6f275458a51416de279339acd89dd9ad1460f16f2941b7be59e43"}
Jun 10 10:18:35.730503 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.730426    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plv8g" event={"ID":"0129c785-2601-4ed8-832d-abe84428173b","Type":"ContainerStarted","Data":"3ac8fd14e035ec2c530406596614f84279379e451b0a2f53e802e63db40df225"}
Jun 10 10:18:35.740830 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:35.740708    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6qdrg" event={"ID":"5a399149-f72c-48c1-8424-e31668063ce5","Type":"ContainerStarted","Data":"9b9e0f66931e167f1593041d0bf689b9c38c88c8f37717a735078cad4ae4c7cb"}
Jun 10 10:18:36.137541 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.137495    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:36.137740 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.137664    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:36.137740 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.137720    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:18:38.137706638 +0000 UTC m=+5.994643049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:36.238118 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.238071    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:36.238305 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.238255    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:36.238384 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.238338    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:38.23831882 +0000 UTC m=+6.095255241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:36.339018 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.338882    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:36.339239 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.339056    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:18:36.339239 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.339085    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:18:36.339239 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.339098    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:36.339239 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.339161    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:38.339141493 +0000 UTC m=+6.196077915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:36.578285 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.577458    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:36.578285 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.577603    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:36.578285 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.578035    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:36.578285 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:36.578125    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:36.599212 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.599171    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 10:13:34 +0000 UTC" deadline="2027-11-29 05:45:32.040612084 +0000 UTC"
Jun 10 10:18:36.599212 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.599209    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12883h26m55.441407739s"
Jun 10 10:18:36.778468 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.778415    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"f3c669b69a13ee0553f96203e0165f26","Type":"ContainerStarted","Data":"a45a1b4d9fdeb9f0ce0e32580bc69bb5e5b9ebdfd1e3230e1ed6de9f649f53c2"}
Jun 10 10:18:36.797027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:36.796966    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" podStartSLOduration=2.79694428 podStartE2EDuration="2.79694428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:36.796652934 +0000 UTC m=+4.653589367" watchObservedRunningTime="2026-06-10 10:18:36.79694428 +0000 UTC m=+4.653880709"
Jun 10 10:18:37.574435 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:37.574403    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:37.574605 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:37.574558    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:38.154730 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:38.154484    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:38.154730 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.154641    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:38.154730 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.154710    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:18:42.154684841 +0000 UTC m=+10.011621252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:38.255040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:38.254989    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:38.255210 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.255160    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:38.255267 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.255222    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:42.255204608 +0000 UTC m=+10.112141041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:38.355377 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:38.355338    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:38.355597 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.355578    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:18:38.355678 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.355604    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:18:38.355678 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.355617    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:38.355678 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.355677    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:42.355656699 +0000 UTC m=+10.212593116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:38.576132 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:38.576035    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:38.576297 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.576183    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:38.576755 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:38.576732    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:38.576871 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:38.576834    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:39.574459 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:39.574396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:39.574930 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:39.574530    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:40.575483 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:40.574987    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:40.575483 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:40.575129    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:40.575483 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:40.575204    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:40.575483 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:40.575311    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:41.574194 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:41.574158    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:41.574413 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:41.574317    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:42.186855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:42.186813    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:42.187342 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.187029    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:42.187342 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.187103    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:18:50.187083543 +0000 UTC m=+18.044019956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:42.287923 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:42.287867    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:42.288100 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.288051    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:42.288170 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.288120    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:50.288101625 +0000 UTC m=+18.145038062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:42.389353 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:42.389239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:42.389607 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.389412    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:18:42.389607 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.389436    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:18:42.389607 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.389450    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:42.389607 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.389507    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:18:50.389492202 +0000 UTC m=+18.246428614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:42.575204 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:42.574898    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:42.575204 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.575036    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:42.575204 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:42.575042    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:42.575204 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:42.575120    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:43.574886 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:43.574406    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:43.574886 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:43.574542    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:44.574537 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:44.574502    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:44.574708 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:44.574548    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:44.574708 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:44.574666    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:44.574819 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:44.574783    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:45.574639 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:45.574613    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:45.575022 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:45.574707    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:46.574715 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:46.574676    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:46.574715 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:46.574709    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:46.575219 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:46.574814    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:46.575219 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:46.574930    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:47.574770 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:47.574736    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:47.575250 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:47.574840    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:48.574827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:48.574790    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:48.575295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:48.574808    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:48.575295 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:48.574961    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:48.575295 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:48.575014    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:49.574362 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:49.574324    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:49.574662 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:49.574464    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:50.248979 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:50.248945    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:50.249395 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.249100    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:50.249395 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.249172    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:19:06.249153453 +0000 UTC m=+34.106089866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:18:50.350307 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:50.350217    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:50.350475 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.350378    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:50.350475 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.350452    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:06.350430781 +0000 UTC m=+34.207367199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:18:50.451255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:50.451215    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:50.451436 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.451409    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:18:50.451436 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.451435    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:18:50.451551 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.451449    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:50.451551 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.451514    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:06.45149611 +0000 UTC m=+34.308432542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:18:50.574863 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:50.574830    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:50.575052 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:50.574845    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:50.575052 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.574980    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:50.575173 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:50.575053    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:51.574029 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:51.573998    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:51.574588 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:51.574117    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:52.574860 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:52.574823    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:52.575334 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:52.574958    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:52.575334 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:52.575014    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:52.575334 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:52.575118    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:53.574604 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:53.574566    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:53.574802 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:53.574692    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:54.574525 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:54.574489    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:54.574924 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:54.574489    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:54.574924 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:54.574605    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:54.574924 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:54.574694    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:55.575097 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.574883    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:55.575757 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:55.575173    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:55.861061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.861017    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" event={"ID":"0cfd7fd91bf7b2135b4a972f86e20b51","Type":"ContainerStarted","Data":"3a8f00ff943c2ae9e664def03616fd2bd81dc186d7100b850b8a27f75d125950"}
Jun 10 10:18:55.862504 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.862466    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ssp29" event={"ID":"5a4ec284-9d48-4a2e-9f6c-72dd62a729d4","Type":"ContainerStarted","Data":"024b1198a619885e54549df576e91a4b713f2e6e696716aad5dd0390d132ca6b"}
Jun 10 10:18:55.863778 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.863753    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7grqz" event={"ID":"a79b7c5e-a57c-4e89-8caa-d83c9c4a0095","Type":"ContainerStarted","Data":"d760eb1dbb17e578bdeadfb049cc1321fee4dcd0fabff492e6871fa4e86d0023"}
Jun 10 10:18:55.865027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.865008    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hdhd4" event={"ID":"2d767806-21d0-4933-bb3f-3671141887ef","Type":"ContainerStarted","Data":"9134cb7ed8d41331419358ad2059a7c6d3e5f299f9362158a06b63c53403aad2"}
Jun 10 10:18:55.866346 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.866328    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxvnf" event={"ID":"ef905838-a1f0-4025-a1cb-279428c11747","Type":"ContainerStarted","Data":"a33e95a11be6ec772934610523a3703ed0d7b9fa0861f663dabe2860ff31f2f2"}
Jun 10 10:18:55.867700 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.867679    2552 generic.go:356] "Generic (PLEG): container finished" podID="68f9c259-4579-47c8-a89d-c24fc5e6d461" containerID="7f5f55fb9658dcb2abded03060eb06b5efb60dc4abea2e917652c003c6012535" exitCode=0
Jun 10 10:18:55.867768 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.867728    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerDied","Data":"7f5f55fb9658dcb2abded03060eb06b5efb60dc4abea2e917652c003c6012535"}
Jun 10 10:18:55.870939 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.870892    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"12b57b16d55e51f7047b20a559698ce6823836afcd24aabd4e4c78ca4a7ac8bb"}
Jun 10 10:18:55.871053 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.870982    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"f4512e32fdd78b205d372be028bebfeb63f861d81f5ca8c3e9ff60b4afb73612"}
Jun 10 10:18:55.871053 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.871037    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"0ee86c9511a561f150dcb9d7b8ec8e06b7758197b3497457e7bc19ddb3713563"}
Jun 10 10:18:55.871135 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.871086    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"21f9fc9944ddbc72d8fc2f45b6e362812b694ad1c2ac2b81d399802b59006bc0"}
Jun 10 10:18:55.871183 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.871135    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"bfbf0992aaa1938786a95ef9989a276892e2793e7424ae4748489d7b605052ec"}
Jun 10 10:18:55.871183 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.871171    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"3d12e1f2f9280e3855b29ade9dd4275295c174e37fae768d2fc5eaa503e03ba5"}
Jun 10 10:18:55.872330 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.872310    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm" event={"ID":"31c92604-74da-4bef-9801-ac3c0a9d26af","Type":"ContainerStarted","Data":"4badae854ecd9bae5271c9d6310f9b13f3495358bf9bfd17d3c4735ab12b94c0"}
Jun 10 10:18:55.873729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.873708    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plv8g" event={"ID":"0129c785-2601-4ed8-832d-abe84428173b","Type":"ContainerStarted","Data":"91fb871c4cef6743a451ee235f77471f501dbe7b04ad61402975a0cf0c6d1261"}
Jun 10 10:18:55.912294 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.912245    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-plv8g" podStartSLOduration=8.716445016 podStartE2EDuration="23.912231115s" totalImagesPullingTime="15.195786099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:55.911554823 +0000 UTC m=+23.768491252" watchObservedRunningTime="2026-06-10 10:18:55.912231115 +0000 UTC m=+23.769167545"
Jun 10 10:18:55.912431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.912318    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" podStartSLOduration=21.91231238 podStartE2EDuration="21.91231238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:55.885192913 +0000 UTC m=+23.742129344" watchObservedRunningTime="2026-06-10 10:18:55.91231238 +0000 UTC m=+23.769248847"
Jun 10 10:18:55.973498 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:55.973455    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7grqz" podStartSLOduration=4.144961502 podStartE2EDuration="23.973439822s" totalImagesPullingTime="19.82847832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:55.97310474 +0000 UTC m=+23.830041194" watchObservedRunningTime="2026-06-10 10:18:55.973439822 +0000 UTC m=+23.830376252"
Jun 10 10:18:56.001513 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.001472    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ssp29" podStartSLOduration=4.180277102 podStartE2EDuration="24.001457902s" totalImagesPullingTime="19.8211808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:56.001167086 +0000 UTC m=+23.858103517" watchObservedRunningTime="2026-06-10 10:18:56.001457902 +0000 UTC m=+23.858394334"
Jun 10 10:18:56.061602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.061546    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dxvnf" podStartSLOduration=4.214750889 podStartE2EDuration="24.061529926s" totalImagesPullingTime="19.846779037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:56.025716267 +0000 UTC m=+23.882652698" watchObservedRunningTime="2026-06-10 10:18:56.061529926 +0000 UTC m=+23.918466353"
Jun 10 10:18:56.213299 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.213277    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 10 10:18:56.574461 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.574385    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:56.574687 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:56.574520    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:56.574687 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.574578    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:56.574801 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:56.574681    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:56.576231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.576149    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T10:18:56.213294672Z","UUID":"a0c8a960-0b43-4d30-8be5-ec79f4d9c83b","Handler":null,"Name":"","Endpoint":""}
Jun 10 10:18:56.577891 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.577874    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 10 10:18:56.578031 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.577920    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 10 10:18:56.879181 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.879138    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm" event={"ID":"31c92604-74da-4bef-9801-ac3c0a9d26af","Type":"ContainerStarted","Data":"4b6af2214587901189571b8322ecbc9fd0297a6cd055e400c14a0b5993a2a438"}
Jun 10 10:18:56.881533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.881502    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6qdrg" event={"ID":"5a399149-f72c-48c1-8424-e31668063ce5","Type":"ContainerStarted","Data":"b6bced8ec3d894c4ba09dfc85860de098848734b03027664a10a6370415a18bc"}
Jun 10 10:18:56.920891 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:56.920831    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hdhd4" podStartSLOduration=5.125821796 podStartE2EDuration="24.920808337s" totalImagesPullingTime="19.794986541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:56.064263682 +0000 UTC m=+23.921200113" watchObservedRunningTime="2026-06-10 10:18:56.920808337 +0000 UTC m=+24.777744769"
Jun 10 10:18:57.574324 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:57.574238    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:57.574486 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:57.574385    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:57.596962 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:57.596936    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hdhd4_2d767806-21d0-4933-bb3f-3671141887ef/dns-node-resolver/0.log"
Jun 10 10:18:57.887268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:57.887229    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"b3ebc90957c232003fe5812810b3af3ca41e5d29798044cc6e11690827cfa028"}
Jun 10 10:18:57.889606 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:57.889575    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm" event={"ID":"31c92604-74da-4bef-9801-ac3c0a9d26af","Type":"ContainerStarted","Data":"d7abab8a509422f0add1f77cfc0218a299479c0faef8c9330f04bc84f51935eb"}
Jun 10 10:18:57.919470 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:57.919413    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6qdrg" podStartSLOduration=6.047635236 podStartE2EDuration="25.919392726s" totalImagesPullingTime="19.87175749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:56.926351191 +0000 UTC m=+24.783287623" watchObservedRunningTime="2026-06-10 10:18:57.919392726 +0000 UTC m=+25.776329137"
Jun 10 10:18:57.919655 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:57.919630    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxnqm" podStartSLOduration=3.847926303 podStartE2EDuration="25.919619195s" totalImagesPullingTime="22.071692892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:18:57.919359147 +0000 UTC m=+25.776295577" watchObservedRunningTime="2026-06-10 10:18:57.919619195 +0000 UTC m=+25.776555627"
Jun 10 10:18:58.568410 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:58.568379    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ssp29_5a4ec284-9d48-4a2e-9f6c-72dd62a729d4/node-ca/0.log"
Jun 10 10:18:58.574639 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:58.574617    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:18:58.574759 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:58.574642    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:18:58.574759 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:58.574716    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:18:58.574853 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:58.574836    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:18:59.574992 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:59.574955    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:18:59.575581 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:18:59.575095    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:18:59.771527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:59.771488    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:59.772385 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:59.772365    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:59.895242 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:59.895203    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:18:59.895702 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:18:59.895682    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-plv8g"
Jun 10 10:19:00.575047 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:00.575015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:00.575544 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:00.575015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:00.575544 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:00.575147    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:00.575544 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:00.575215    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:00.901557 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:00.901431    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" event={"ID":"2e30ff2c-3b5d-4515-b2a8-f60475fbf444","Type":"ContainerStarted","Data":"4d2650e4c5c72f2ede597c36e5ca04e33a9e351ed230b2dc3573c036471b3dd9"}
Jun 10 10:19:00.938851 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:00.938812    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv" podStartSLOduration=9.003694388 podStartE2EDuration="28.938795775s" totalImagesPullingTime="19.935101387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:00.938589043 +0000 UTC m=+28.795525472" watchObservedRunningTime="2026-06-10 10:19:00.938795775 +0000 UTC m=+28.795732205"
Jun 10 10:19:01.574799 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.574762    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:01.575004 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:01.574874    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:01.905825 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.905788    2552 generic.go:356] "Generic (PLEG): container finished" podID="68f9c259-4579-47c8-a89d-c24fc5e6d461" containerID="8758c31364212d0e3b9952d8149d98d8bd5040f25d1a41d31bd1cb858b904c9e" exitCode=0
Jun 10 10:19:01.906345 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.905880    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerDied","Data":"8758c31364212d0e3b9952d8149d98d8bd5040f25d1a41d31bd1cb858b904c9e"}
Jun 10 10:19:01.906530 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.906513    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:19:01.906627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.906577    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:19:01.906627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.906619    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:19:01.921815 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.921792    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:19:01.921990 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:01.921892    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:19:02.575237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:02.575212    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:02.575418 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:02.575329    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:02.575418 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:02.575344    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:02.575515 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:02.575443    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:03.574263 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:03.574226    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:03.574641 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:03.574333    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:03.911894 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:03.911854    2552 generic.go:356] "Generic (PLEG): container finished" podID="68f9c259-4579-47c8-a89d-c24fc5e6d461" containerID="e0a1ed983f96682e0006d004dc1025559a46a7509ff70b7408c3967c227772ad" exitCode=0
Jun 10 10:19:03.912165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:03.911888    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerDied","Data":"e0a1ed983f96682e0006d004dc1025559a46a7509ff70b7408c3967c227772ad"}
Jun 10 10:19:04.574676 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:04.574645    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:04.575097 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:04.574646    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:04.575097 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:04.574751    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:04.575097 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:04.574841    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:05.574899 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:05.574863    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:05.575261 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:05.574995    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:05.917573 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:05.917537    2552 generic.go:356] "Generic (PLEG): container finished" podID="68f9c259-4579-47c8-a89d-c24fc5e6d461" containerID="c9190e015b2eed8baac284648db12fe9005cff6aeec8eee10a1ffb8fb8aa5b75" exitCode=0
Jun 10 10:19:05.917725 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:05.917595    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerDied","Data":"c9190e015b2eed8baac284648db12fe9005cff6aeec8eee10a1ffb8fb8aa5b75"}
Jun 10 10:19:06.269275 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:06.269185    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:06.269426 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.269345    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:19:06.269426 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.269405    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs podName:76422cdb-4abe-4de3-a33f-49aafeeaa38c nodeName:}" failed. No retries permitted until 2026-06-10 10:19:38.269384963 +0000 UTC m=+66.126321387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs") pod "network-metrics-daemon-fznl8" (UID: "76422cdb-4abe-4de3-a33f-49aafeeaa38c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 10:19:06.369846 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:06.369810    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:06.370051 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.369951    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 10:19:06.370051 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.370007    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret podName:5ef86f68-d30d-4000-97d6-29d744549b05 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:38.369992883 +0000 UTC m=+66.226929292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret") pod "global-pull-secret-syncer-cs4zm" (UID: "5ef86f68-d30d-4000-97d6-29d744549b05") : object "kube-system"/"original-pull-secret" not registered
Jun 10 10:19:06.470841 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:06.470801    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:06.471034 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.471000    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 10:19:06.471034 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.471030    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 10:19:06.471214 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.471046    2552 projected.go:196] Error preparing data for projected volume kube-api-access-92hcd for pod openshift-network-diagnostics/network-check-target-jcnpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:19:06.471214 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.471115    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd podName:5e32543a-b771-4347-86c9-a65ac22df508 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:38.471094889 +0000 UTC m=+66.328031313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-92hcd" (UniqueName: "kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd") pod "network-check-target-jcnpv" (UID: "5e32543a-b771-4347-86c9-a65ac22df508") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 10:19:06.574738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:06.574659    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:06.574882 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.574799    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:06.574882 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:06.574841    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:06.575327 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:06.574987    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:07.574742 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:07.574711    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:07.574943 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:07.574819    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:08.575162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:08.574894    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:08.575593 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:08.574973    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:08.575593 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:08.575286    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:08.575593 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:08.575347    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:09.574208 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:09.574176    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:09.574400 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:09.574315    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:10.574770 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:10.574739    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:10.575423 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:10.575401    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:10.577866 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:10.575316    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:10.577866 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:10.577035    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:10.932547 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:10.932513    2552 generic.go:356] "Generic (PLEG): container finished" podID="68f9c259-4579-47c8-a89d-c24fc5e6d461" containerID="a28f7227ad26d9f00de2c8fd0f0dd677748aac2206a3be9565c02ba19537346a" exitCode=0
Jun 10 10:19:10.932714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:10.932568    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerDied","Data":"a28f7227ad26d9f00de2c8fd0f0dd677748aac2206a3be9565c02ba19537346a"}
Jun 10 10:19:11.574337 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:11.574301    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:11.574509 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:11.574405    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:11.937604 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:11.937568    2552 generic.go:356] "Generic (PLEG): container finished" podID="68f9c259-4579-47c8-a89d-c24fc5e6d461" containerID="7b666aba224064b15ef2de376807c38a17ca3dee8c51f06e6a76a00f8f5f42fc" exitCode=0
Jun 10 10:19:11.938141 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:11.937635    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerDied","Data":"7b666aba224064b15ef2de376807c38a17ca3dee8c51f06e6a76a00f8f5f42fc"}
Jun 10 10:19:12.575476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:12.575435    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:12.575662 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:12.575561    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:12.575662 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:12.575600    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:12.575787 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:12.575669    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:12.942585 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:12.942549    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" event={"ID":"68f9c259-4579-47c8-a89d-c24fc5e6d461","Type":"ContainerStarted","Data":"96ff9ed9d7b0417d1df8eab6b14893763dc2ed7e6210c76154292cd970cdbe32"}
Jun 10 10:19:12.966970 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:12.966923    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hlsr6" podStartSLOduration=10.084241524 podStartE2EDuration="40.966891169s" totalImagesPullingTime="30.882649645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:12.965623784 +0000 UTC m=+40.822560214" watchObservedRunningTime="2026-06-10 10:19:12.966891169 +0000 UTC m=+40.823827600"
Jun 10 10:19:13.574971 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:13.574937    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:13.575139 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:13.575032    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:14.574309 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:14.574264    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:14.574677 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:14.574284    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:14.574677 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:14.574370    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:14.574677 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:14.574482    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:15.574834 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:15.574797    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:15.575211 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:15.574923    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:16.574925 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:16.574880    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:16.575302 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:16.575005    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:16.575302 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:16.575036    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:16.575302 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:16.575081    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:17.574433 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:17.574402    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:17.574594 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:17.574497    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:18.574514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:18.574478    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:18.575015 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:18.574488    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:18.575015 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:18.574596    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:18.575015 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:18.574687    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:19.574779 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:19.574743    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:19.575209 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:19.574850    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:20.575050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:20.575014    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:20.575449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:20.575010    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:20.575449 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:20.575130    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:20.575449 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:20.575203    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:21.574078 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.574040    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:21.574259 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:21.574175    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:21.858703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.858673    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jcnpv"]
Jun 10 10:19:21.859322 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.858779    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:21.859322 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:21.858875    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:21.861654 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.861618    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cs4zm"]
Jun 10 10:19:21.862410 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.862385    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fznl8"]
Jun 10 10:19:21.862624 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.862605    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:21.862726 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:21.862707    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:21.961719 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:21.961693    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:21.961923 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:21.961794    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:23.574529 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:23.574495    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:23.574994 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:23.574495    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:23.574994 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:23.574609    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fznl8" podUID="76422cdb-4abe-4de3-a33f-49aafeeaa38c"
Jun 10 10:19:23.574994 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:23.574495    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:23.574994 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:23.574670    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcnpv" podUID="5e32543a-b771-4347-86c9-a65ac22df508"
Jun 10 10:19:23.574994 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:23.574751    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs4zm" podUID="5ef86f68-d30d-4000-97d6-29d744549b05"
Jun 10 10:19:25.491477 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.491210    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeReady"
Jun 10 10:19:25.491901 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.491498    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 10 10:19:25.544805 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.544772    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r9sbd"]
Jun 10 10:19:25.567149 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.567106    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wflhq"]
Jun 10 10:19:25.567149 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.567138    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.570121 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.570097    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 10 10:19:25.570316 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.570216    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 10 10:19:25.570385 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.570340    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7cfq\""
Jun 10 10:19:25.583003 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.582977    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9sbd"]
Jun 10 10:19:25.583003 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.583000    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.583165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.583022    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wflhq"]
Jun 10 10:19:25.583165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.583045    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vrp7k"]
Jun 10 10:19:25.583165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.583103    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:25.583333 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.583314    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:25.583499 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.583482    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:25.586156 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.586125    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 10:19:25.586287 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.586125    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 10:19:25.586500 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.586487    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n4x9s\""
Jun 10 10:19:25.587409 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587388    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cb5mx\""
Jun 10 10:19:25.587808 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587686    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 10 10:19:25.587808 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587707    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 10:19:25.587808 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587774    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 10 10:19:25.587808 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587782    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 10 10:19:25.587808 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587774    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t95hp\""
Jun 10 10:19:25.588059 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.587707    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 10:19:25.601194 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.601169    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vrp7k"]
Jun 10 10:19:25.601305 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.601268    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.603757 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.603737    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 10 10:19:25.603863 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.603848    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 10 10:19:25.603952 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.603886    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 10 10:19:25.603952 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.603898    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 10 10:19:25.604042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.603922    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4cxzv\""
Jun 10 10:19:25.624199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624171    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cc7e4ce-bceb-432b-a386-749992dc64d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624205    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xthv\" (UniqueName: \"kubernetes.io/projected/3730d957-6932-417e-bc01-546db8a637bf-kube-api-access-7xthv\") pod \"ingress-canary-wflhq\" (UID: \"3730d957-6932-417e-bc01-546db8a637bf\") " pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624224    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cc7e4ce-bceb-432b-a386-749992dc64d8-crio-socket\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624252    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adec1928-0d05-4ff0-9d28-a26b633eb25f-tmp-dir\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624284    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec1928-0d05-4ff0-9d28-a26b633eb25f-metrics-tls\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624300    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3730d957-6932-417e-bc01-546db8a637bf-cert\") pod \"ingress-canary-wflhq\" (UID: \"3730d957-6932-417e-bc01-546db8a637bf\") " pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624316    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cc7e4ce-bceb-432b-a386-749992dc64d8-data-volume\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.624342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624331    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cc7e4ce-bceb-432b-a386-749992dc64d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.624552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624360    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85xhg\" (UniqueName: \"kubernetes.io/projected/adec1928-0d05-4ff0-9d28-a26b633eb25f-kube-api-access-85xhg\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.624552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624427    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adec1928-0d05-4ff0-9d28-a26b633eb25f-config-volume\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.624552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.624445    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9f9\" (UniqueName: \"kubernetes.io/projected/1cc7e4ce-bceb-432b-a386-749992dc64d8-kube-api-access-kc9f9\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725178 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725143    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adec1928-0d05-4ff0-9d28-a26b633eb25f-config-volume\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.725178 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725180    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9f9\" (UniqueName: \"kubernetes.io/projected/1cc7e4ce-bceb-432b-a386-749992dc64d8-kube-api-access-kc9f9\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725199    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cc7e4ce-bceb-432b-a386-749992dc64d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725220    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xthv\" (UniqueName: \"kubernetes.io/projected/3730d957-6932-417e-bc01-546db8a637bf-kube-api-access-7xthv\") pod \"ingress-canary-wflhq\" (UID: \"3730d957-6932-417e-bc01-546db8a637bf\") " pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725272    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cc7e4ce-bceb-432b-a386-749992dc64d8-crio-socket\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725326    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adec1928-0d05-4ff0-9d28-a26b633eb25f-tmp-dir\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725354    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec1928-0d05-4ff0-9d28-a26b633eb25f-metrics-tls\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725380    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3730d957-6932-417e-bc01-546db8a637bf-cert\") pod \"ingress-canary-wflhq\" (UID: \"3730d957-6932-417e-bc01-546db8a637bf\") " pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725397    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cc7e4ce-bceb-432b-a386-749992dc64d8-crio-socket\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725406    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cc7e4ce-bceb-432b-a386-749992dc64d8-data-volume\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725433    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cc7e4ce-bceb-432b-a386-749992dc64d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725483    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85xhg\" (UniqueName: \"kubernetes.io/projected/adec1928-0d05-4ff0-9d28-a26b633eb25f-kube-api-access-85xhg\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.725903 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725811    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cc7e4ce-bceb-432b-a386-749992dc64d8-data-volume\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.725903 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725886    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adec1928-0d05-4ff0-9d28-a26b633eb25f-config-volume\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.726040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.725895    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cc7e4ce-bceb-432b-a386-749992dc64d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.726096 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.726055    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adec1928-0d05-4ff0-9d28-a26b633eb25f-tmp-dir\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.729171 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.729147    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec1928-0d05-4ff0-9d28-a26b633eb25f-metrics-tls\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.729293 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.729275    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cc7e4ce-bceb-432b-a386-749992dc64d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.729361 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.729339    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3730d957-6932-417e-bc01-546db8a637bf-cert\") pod \"ingress-canary-wflhq\" (UID: \"3730d957-6932-417e-bc01-546db8a637bf\") " pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.734450 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.734428    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85xhg\" (UniqueName: \"kubernetes.io/projected/adec1928-0d05-4ff0-9d28-a26b633eb25f-kube-api-access-85xhg\") pod \"dns-default-r9sbd\" (UID: \"adec1928-0d05-4ff0-9d28-a26b633eb25f\") " pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.734727 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.734707    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xthv\" (UniqueName: \"kubernetes.io/projected/3730d957-6932-417e-bc01-546db8a637bf-kube-api-access-7xthv\") pod \"ingress-canary-wflhq\" (UID: \"3730d957-6932-417e-bc01-546db8a637bf\") " pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.735941 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.735922    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9f9\" (UniqueName: \"kubernetes.io/projected/1cc7e4ce-bceb-432b-a386-749992dc64d8-kube-api-access-kc9f9\") pod \"insights-runtime-extractor-vrp7k\" (UID: \"1cc7e4ce-bceb-432b-a386-749992dc64d8\") " pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:25.880733 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.880702    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:25.911853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.911822    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wflhq"
Jun 10 10:19:25.916976 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:25.916957    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vrp7k"
Jun 10 10:19:26.096783 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.096754    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wflhq"]
Jun 10 10:19:26.100231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.100198    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9sbd"]
Jun 10 10:19:26.100677 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:26.100649    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3730d957_6932_417e_bc01_546db8a637bf.slice/crio-bd4ae3afe8fcfeac7887159e6f5c7489c4fc48739e822d82e27e73f375f997b1 WatchSource:0}: Error finding container bd4ae3afe8fcfeac7887159e6f5c7489c4fc48739e822d82e27e73f375f997b1: Status 404 returned error can't find the container with id bd4ae3afe8fcfeac7887159e6f5c7489c4fc48739e822d82e27e73f375f997b1
Jun 10 10:19:26.103825 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:26.103799    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadec1928_0d05_4ff0_9d28_a26b633eb25f.slice/crio-4739e1ea9b7ca74de8501368a8f678d7b7bfadeb619847c9b46ef4786fecdda0 WatchSource:0}: Error finding container 4739e1ea9b7ca74de8501368a8f678d7b7bfadeb619847c9b46ef4786fecdda0: Status 404 returned error can't find the container with id 4739e1ea9b7ca74de8501368a8f678d7b7bfadeb619847c9b46ef4786fecdda0
Jun 10 10:19:26.106761 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.106738    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vrp7k"]
Jun 10 10:19:26.111030 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:26.111005    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc7e4ce_bceb_432b_a386_749992dc64d8.slice/crio-69db13ece3a54b15437453a25e679c761f1af6bb2ee93f6303ef22e6cb721130 WatchSource:0}: Error finding container 69db13ece3a54b15437453a25e679c761f1af6bb2ee93f6303ef22e6cb721130: Status 404 returned error can't find the container with id 69db13ece3a54b15437453a25e679c761f1af6bb2ee93f6303ef22e6cb721130
Jun 10 10:19:26.975880 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.975846    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrp7k" event={"ID":"1cc7e4ce-bceb-432b-a386-749992dc64d8","Type":"ContainerStarted","Data":"652416a3b4826ea6da578712152fbc9b517256d1092faf0642698faec80b2727"}
Jun 10 10:19:26.976317 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.975926    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrp7k" event={"ID":"1cc7e4ce-bceb-432b-a386-749992dc64d8","Type":"ContainerStarted","Data":"69db13ece3a54b15437453a25e679c761f1af6bb2ee93f6303ef22e6cb721130"}
Jun 10 10:19:26.977186 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.977158    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wflhq" event={"ID":"3730d957-6932-417e-bc01-546db8a637bf","Type":"ContainerStarted","Data":"bd4ae3afe8fcfeac7887159e6f5c7489c4fc48739e822d82e27e73f375f997b1"}
Jun 10 10:19:26.978539 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:26.978512    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9sbd" event={"ID":"adec1928-0d05-4ff0-9d28-a26b633eb25f","Type":"ContainerStarted","Data":"4739e1ea9b7ca74de8501368a8f678d7b7bfadeb619847c9b46ef4786fecdda0"}
Jun 10 10:19:27.327713 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.325635    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"]
Jun 10 10:19:27.342228 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.342178    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"]
Jun 10 10:19:27.342406 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.342285    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.345160 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.345128    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 10 10:19:27.345295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.345215    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 10 10:19:27.346710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.346238    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 10 10:19:27.346710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.346537    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w9bl2\""
Jun 10 10:19:27.346710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.346664    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 10 10:19:27.347012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.346973    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 10 10:19:27.439879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.439838    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.440081 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.439886    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.440081 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.440012    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xrwq\" (UniqueName: \"kubernetes.io/projected/c7ccb29e-bc92-42eb-af69-751f7578fbe8-kube-api-access-8xrwq\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.440198 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.440149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7ccb29e-bc92-42eb-af69-751f7578fbe8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.541776 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.541522    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xrwq\" (UniqueName: \"kubernetes.io/projected/c7ccb29e-bc92-42eb-af69-751f7578fbe8-kube-api-access-8xrwq\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.541776 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.541627    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7ccb29e-bc92-42eb-af69-751f7578fbe8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.541776 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.541672    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.541776 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.541699    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.542161 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:27.541807    2552 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 10 10:19:27.542161 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:27.541887    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-tls podName:c7ccb29e-bc92-42eb-af69-751f7578fbe8 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:28.041865685 +0000 UTC m=+55.898802107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-4jm8b" (UID: "c7ccb29e-bc92-42eb-af69-751f7578fbe8") : secret "prometheus-operator-tls" not found
Jun 10 10:19:27.542572 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.542543    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7ccb29e-bc92-42eb-af69-751f7578fbe8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.546115 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.546064    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.551614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.551573    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xrwq\" (UniqueName: \"kubernetes.io/projected/c7ccb29e-bc92-42eb-af69-751f7578fbe8-kube-api-access-8xrwq\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:27.796441 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.796404    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-5xd68"]
Jun 10 10:19:27.798499 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.798474    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:27.801780 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.801136    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 10 10:19:27.801780 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.801407    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 10 10:19:27.801780 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.801613    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rt842\""
Jun 10 10:19:27.809689 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.809626    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-5xd68"]
Jun 10 10:19:27.844194 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.844149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5gpj\" (UniqueName: \"kubernetes.io/projected/71657fc6-205f-46c9-b110-4564cd3fc7db-kube-api-access-t5gpj\") pod \"downloads-6657875f97-5xd68\" (UID: \"71657fc6-205f-46c9-b110-4564cd3fc7db\") " pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:27.944970 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.944920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5gpj\" (UniqueName: \"kubernetes.io/projected/71657fc6-205f-46c9-b110-4564cd3fc7db-kube-api-access-t5gpj\") pod \"downloads-6657875f97-5xd68\" (UID: \"71657fc6-205f-46c9-b110-4564cd3fc7db\") " pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:27.966476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.966400    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5gpj\" (UniqueName: \"kubernetes.io/projected/71657fc6-205f-46c9-b110-4564cd3fc7db-kube-api-access-t5gpj\") pod \"downloads-6657875f97-5xd68\" (UID: \"71657fc6-205f-46c9-b110-4564cd3fc7db\") " pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:27.983703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:27.983668    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrp7k" event={"ID":"1cc7e4ce-bceb-432b-a386-749992dc64d8","Type":"ContainerStarted","Data":"e49980cff58d411d28c20dbb8956011058a54fa8c32e14feb5a70075f535adaa"}
Jun 10 10:19:28.045702 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.045662    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:28.048793 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.048723    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ccb29e-bc92-42eb-af69-751f7578fbe8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4jm8b\" (UID: \"c7ccb29e-bc92-42eb-af69-751f7578fbe8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:28.111217 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.111178    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:28.254947 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.254837    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"
Jun 10 10:19:28.944768 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.944731    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b"]
Jun 10 10:19:28.948544 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:28.948521    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ccb29e_bc92_42eb_af69_751f7578fbe8.slice/crio-d9190dd8b4422857f2e39443cfe7fa51217e471490824ce62c8aac824022fec9 WatchSource:0}: Error finding container d9190dd8b4422857f2e39443cfe7fa51217e471490824ce62c8aac824022fec9: Status 404 returned error can't find the container with id d9190dd8b4422857f2e39443cfe7fa51217e471490824ce62c8aac824022fec9
Jun 10 10:19:28.965475 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.965447    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-5xd68"]
Jun 10 10:19:28.974240 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:28.974022    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71657fc6_205f_46c9_b110_4564cd3fc7db.slice/crio-395d0b175a823caca5775a287b8c664acb484f9f06e403ac7ecf250699dd1c7f WatchSource:0}: Error finding container 395d0b175a823caca5775a287b8c664acb484f9f06e403ac7ecf250699dd1c7f: Status 404 returned error can't find the container with id 395d0b175a823caca5775a287b8c664acb484f9f06e403ac7ecf250699dd1c7f
Jun 10 10:19:28.989681 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.989594    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9sbd" event={"ID":"adec1928-0d05-4ff0-9d28-a26b633eb25f","Type":"ContainerStarted","Data":"94346c33cdfaa513d97b3611ec6a914643674302da7abbacb6282c9c3bb41c68"}
Jun 10 10:19:28.991806 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.991741    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b" event={"ID":"c7ccb29e-bc92-42eb-af69-751f7578fbe8","Type":"ContainerStarted","Data":"d9190dd8b4422857f2e39443cfe7fa51217e471490824ce62c8aac824022fec9"}
Jun 10 10:19:28.993736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.993429    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wflhq" event={"ID":"3730d957-6932-417e-bc01-546db8a637bf","Type":"ContainerStarted","Data":"cb4dd177f0505bd6557c29cba924a61cfab54c229725e79a8c41fa7fefad5908"}
Jun 10 10:19:28.995264 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.995192    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-5xd68" event={"ID":"71657fc6-205f-46c9-b110-4564cd3fc7db","Type":"ContainerStarted","Data":"395d0b175a823caca5775a287b8c664acb484f9f06e403ac7ecf250699dd1c7f"}
Jun 10 10:19:28.998764 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:28.998719    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrp7k" event={"ID":"1cc7e4ce-bceb-432b-a386-749992dc64d8","Type":"ContainerStarted","Data":"3256bc9e251b28ce02e7cad241133e979fc7486124de47e8cb363dc9f6bffc21"}
Jun 10 10:19:29.029317 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:29.029100    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wflhq" podStartSLOduration=1.301348947 podStartE2EDuration="4.029082574s" totalImagesPullingTime="2.727733627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:29.010053327 +0000 UTC m=+56.866989760" watchObservedRunningTime="2026-06-10 10:19:29.029082574 +0000 UTC m=+56.886019004"
Jun 10 10:19:29.029554 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:29.029512    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vrp7k" podStartSLOduration=1.528798247 podStartE2EDuration="4.029503482s" totalImagesPullingTime="2.500705235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:19:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:29.027734789 +0000 UTC m=+56.884671220" watchObservedRunningTime="2026-06-10 10:19:29.029503482 +0000 UTC m=+56.886439957"
Jun 10 10:19:30.008327 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:30.008283    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9sbd" event={"ID":"adec1928-0d05-4ff0-9d28-a26b633eb25f","Type":"ContainerStarted","Data":"62ab352cf4f00eec73d25b54956ec26e653f2c3ac8f156932657b75f4e02c4cf"}
Jun 10 10:19:30.008868 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:30.008818    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:30.026306 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:30.026112    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r9sbd" podStartSLOduration=2.343530631 podStartE2EDuration="5.026097011s" totalImagesPullingTime="2.68256638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:30.025930767 +0000 UTC m=+57.882867199" watchObservedRunningTime="2026-06-10 10:19:30.026097011 +0000 UTC m=+57.883033441"
Jun 10 10:19:31.012428 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:31.012391    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b" event={"ID":"c7ccb29e-bc92-42eb-af69-751f7578fbe8","Type":"ContainerStarted","Data":"0d7a857fd0dd5fd27e618ef4a57c2506d271e195a8c139418e941160ae802f43"}
Jun 10 10:19:31.012872 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:31.012456    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b" event={"ID":"c7ccb29e-bc92-42eb-af69-751f7578fbe8","Type":"ContainerStarted","Data":"e9bf1cbdb71b4df269f1c509846b6aa9f7686c629ec99c71a568f0144dc4148d"}
Jun 10 10:19:31.030737 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:31.030681    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4jm8b" podStartSLOduration=2.891060911 podStartE2EDuration="4.030664199s" totalImagesPullingTime="1.139603288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:31.030335521 +0000 UTC m=+58.887271952" watchObservedRunningTime="2026-06-10 10:19:31.030664199 +0000 UTC m=+58.887600629"
Jun 10 10:19:32.673899 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.673860    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"]
Jun 10 10:19:32.676674 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.676650    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.679191 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.679163    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 10 10:19:32.679191 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.679186    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 10 10:19:32.679482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.679444    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x5xmd\""
Jun 10 10:19:32.689596 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.689567    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"]
Jun 10 10:19:32.691747 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.691722    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8wsx8"]
Jun 10 10:19:32.695945 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.695916    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.698793 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.698773    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 10 10:19:32.698899 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.698821    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 10 10:19:32.699337 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.699320    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 10 10:19:32.699480 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.699465    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjxb9\""
Jun 10 10:19:32.704054 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.704028    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"]
Jun 10 10:19:32.707799 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.707784    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.710348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.710328    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 10 10:19:32.710419 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.710363    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 10 10:19:32.710419 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.710363    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-72pcr\""
Jun 10 10:19:32.710512 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.710363    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 10 10:19:32.720860 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.720831    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"]
Jun 10 10:19:32.786820 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.786783    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df52090-d79c-412b-b68e-f6c08ac097a7-metrics-client-ca\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787014 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.786836    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.787014 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.786865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87a28841-bbee-4ed1-84c1-cffd862a9349-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.787014 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.786901    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-textfile\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787014 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.786946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787014 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.786978    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-wtmp\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787014 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787000    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.787304 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787052    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqqd\" (UniqueName: \"kubernetes.io/projected/7df52090-d79c-412b-b68e-f6c08ac097a7-kube-api-access-lpqqd\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787304 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787127    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvjs\" (UniqueName: \"kubernetes.io/projected/8f4955e0-9723-494d-bd37-2f97c08ad7f0-kube-api-access-8tvjs\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.787304 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787183    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787304 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787297    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-tls\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787381    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.787496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.787496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787482    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58b8h\" (UniqueName: \"kubernetes.io/projected/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-api-access-58b8h\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.787613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787501    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-root\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787532    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f4955e0-9723-494d-bd37-2f97c08ad7f0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.787613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787554    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-sys\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.787613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/87a28841-bbee-4ed1-84c1-cffd862a9349-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.787613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.787598    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.888195 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888160    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-textfile\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888195 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888196    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888395 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888222    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-wtmp\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888451 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888426    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.888499 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-wtmp\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888499 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888474    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqqd\" (UniqueName: \"kubernetes.io/projected/7df52090-d79c-412b-b68e-f6c08ac097a7-kube-api-access-lpqqd\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888592 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888506    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvjs\" (UniqueName: \"kubernetes.io/projected/8f4955e0-9723-494d-bd37-2f97c08ad7f0-kube-api-access-8tvjs\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.888592 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888527    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-textfile\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888686 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888629    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888686 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888669    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-tls\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888783 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888716    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.888783 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888745    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.888873 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888787    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58b8h\" (UniqueName: \"kubernetes.io/projected/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-api-access-58b8h\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.888873 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888813    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-root\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.888873 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:32.888830    2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 10 10:19:32.888873 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888842    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f4955e0-9723-494d-bd37-2f97c08ad7f0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.888873 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888869    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-sys\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:32.888894    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-tls podName:7df52090-d79c-412b-b68e-f6c08ac097a7 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:33.38887468 +0000 UTC m=+61.245811090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-tls") pod "node-exporter-8wsx8" (UID: "7df52090-d79c-412b-b68e-f6c08ac097a7") : secret "node-exporter-tls" not found
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888942    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-sys\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888965    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/87a28841-bbee-4ed1-84c1-cffd862a9349-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888991    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df52090-d79c-412b-b68e-f6c08ac097a7-root\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888999    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.888840    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889029    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df52090-d79c-412b-b68e-f6c08ac097a7-metrics-client-ca\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889057    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.889142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889099    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87a28841-bbee-4ed1-84c1-cffd862a9349-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.889581 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889408    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/87a28841-bbee-4ed1-84c1-cffd862a9349-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.889870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889670    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.889870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889721    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87a28841-bbee-4ed1-84c1-cffd862a9349-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.889870 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:32.889797    2552 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 10 10:19:32.889870 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:32.889845    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-tls podName:8f4955e0-9723-494d-bd37-2f97c08ad7f0 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:33.389828941 +0000 UTC m=+61.246765356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-fggd2" (UID: "8f4955e0-9723-494d-bd37-2f97c08ad7f0") : secret "openshift-state-metrics-tls" not found
Jun 10 10:19:32.890156 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.889951    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df52090-d79c-412b-b68e-f6c08ac097a7-metrics-client-ca\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.890211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.890184    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f4955e0-9723-494d-bd37-2f97c08ad7f0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.891412 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.891379    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.891505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.891406    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.891505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.891421    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.891859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.891837    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:32.896532 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.896509    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqqd\" (UniqueName: \"kubernetes.io/projected/7df52090-d79c-412b-b68e-f6c08ac097a7-kube-api-access-lpqqd\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:32.897392 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.897371    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvjs\" (UniqueName: \"kubernetes.io/projected/8f4955e0-9723-494d-bd37-2f97c08ad7f0-kube-api-access-8tvjs\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:32.897749 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:32.897727    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58b8h\" (UniqueName: \"kubernetes.io/projected/87a28841-bbee-4ed1-84c1-cffd862a9349-kube-api-access-58b8h\") pod \"kube-state-metrics-57bbf8bfb5-4wwpj\" (UID: \"87a28841-bbee-4ed1-84c1-cffd862a9349\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:33.016270 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.016172    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"
Jun 10 10:19:33.208274 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.208235    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj"]
Jun 10 10:19:33.212707 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:33.212676    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a28841_bbee_4ed1_84c1_cffd862a9349.slice/crio-25734dea70681e56e5a4886ef563f1e96c9df63608d340d3318e2cda4d691dfc WatchSource:0}: Error finding container 25734dea70681e56e5a4886ef563f1e96c9df63608d340d3318e2cda4d691dfc: Status 404 returned error can't find the container with id 25734dea70681e56e5a4886ef563f1e96c9df63608d340d3318e2cda4d691dfc
Jun 10 10:19:33.392640 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.392599    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-tls\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:33.392826 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.392773    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:33.395069 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.395043    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df52090-d79c-412b-b68e-f6c08ac097a7-node-exporter-tls\") pod \"node-exporter-8wsx8\" (UID: \"7df52090-d79c-412b-b68e-f6c08ac097a7\") " pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:33.395195 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.395098    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f4955e0-9723-494d-bd37-2f97c08ad7f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fggd2\" (UID: \"8f4955e0-9723-494d-bd37-2f97c08ad7f0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:33.586893 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.586856    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"
Jun 10 10:19:33.606265 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.606235    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8wsx8"
Jun 10 10:19:33.661612 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:33.661565    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df52090_d79c_412b_b68e_f6c08ac097a7.slice/crio-342fcff02fe07aed58d4db8af5165c3173f2432815494172afe2c216cbe78f7e WatchSource:0}: Error finding container 342fcff02fe07aed58d4db8af5165c3173f2432815494172afe2c216cbe78f7e: Status 404 returned error can't find the container with id 342fcff02fe07aed58d4db8af5165c3173f2432815494172afe2c216cbe78f7e
Jun 10 10:19:33.775007 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.774897    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2"]
Jun 10 10:19:33.780237 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:33.780186    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4955e0_9723_494d_bd37_2f97c08ad7f0.slice/crio-af409ec4fa9e1542b31b67b55dc552086e3051b6fabf1d6fd98e241e548d37a5 WatchSource:0}: Error finding container af409ec4fa9e1542b31b67b55dc552086e3051b6fabf1d6fd98e241e548d37a5: Status 404 returned error can't find the container with id af409ec4fa9e1542b31b67b55dc552086e3051b6fabf1d6fd98e241e548d37a5
Jun 10 10:19:33.798588 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.798561    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:19:33.835184 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.833307    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:19:33.835184 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.833504    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.836940 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.836893    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 10 10:19:33.837148 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.837132    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 10 10:19:33.837368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.837331    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 10 10:19:33.837710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.837688    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 10 10:19:33.838319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.838169    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 10 10:19:33.838432 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.838383    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 10 10:19:33.838897 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.838576    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 10 10:19:33.838897 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.838753    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vtv9z\""
Jun 10 10:19:33.839053 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.838943    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 10 10:19:33.839193 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.839176    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897667    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897714    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897748    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897784    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897815    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897855    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897882    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzx2m\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-kube-api-access-nzx2m\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898012 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.897931    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-web-config\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898618 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.898064    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898618 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.898133    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898618 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.898179    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898618 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.898220    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-config-out\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.898618 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.898261    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.936468 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.936067    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6lbv"
Jun 10 10:19:33.999606 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999555    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.999606 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999611    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzx2m\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-kube-api-access-nzx2m\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.999848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999645    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-web-config\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.999848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999708    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.999848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999743    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.999848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999783    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:33.999848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999826    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-config-out\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.000120 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999887    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.000120 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:33.999953    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.000120 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:34.000039    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 10 10:19:34.000120 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:34.000101    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls podName:4b07f540-a7bf-484a-a265-3abc7f286d93 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:34.500079982 +0000 UTC m=+62.357016423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93") : secret "alertmanager-main-tls" not found
Jun 10 10:19:34.001132 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.001105    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.001204 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.001144    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.001204 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.001187    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.001315 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.001245    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.002608 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.002172    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.002608 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.002315    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.002757 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.002670    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.003528 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.003501    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.006859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.004473    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-web-config\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.006859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.004484    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.006859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.005568    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.006859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.005758    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.007240 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.007015    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.007529 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.007340    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.007529 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.007488    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-config-out\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.009726 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.009705    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzx2m\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-kube-api-access-nzx2m\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.027170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.027135    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2" event={"ID":"8f4955e0-9723-494d-bd37-2f97c08ad7f0","Type":"ContainerStarted","Data":"5681eda66c2956d453793c40526d9f6a5aa042ffd826ad319be3a1e50597b50a"}
Jun 10 10:19:34.027337 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.027211    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2" event={"ID":"8f4955e0-9723-494d-bd37-2f97c08ad7f0","Type":"ContainerStarted","Data":"4b698cafe2a3ff4aaa49ce942834895885febec3a3bf9878b74ab8e767489e4b"}
Jun 10 10:19:34.027337 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.027244    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2" event={"ID":"8f4955e0-9723-494d-bd37-2f97c08ad7f0","Type":"ContainerStarted","Data":"af409ec4fa9e1542b31b67b55dc552086e3051b6fabf1d6fd98e241e548d37a5"}
Jun 10 10:19:34.029054 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.029025    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wsx8" event={"ID":"7df52090-d79c-412b-b68e-f6c08ac097a7","Type":"ContainerStarted","Data":"342fcff02fe07aed58d4db8af5165c3173f2432815494172afe2c216cbe78f7e"}
Jun 10 10:19:34.030631 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.030605    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj" event={"ID":"87a28841-bbee-4ed1-84c1-cffd862a9349","Type":"ContainerStarted","Data":"25734dea70681e56e5a4886ef563f1e96c9df63608d340d3318e2cda4d691dfc"}
Jun 10 10:19:34.506434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.506392    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.509849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.509566    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.754653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.754610    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:19:34.792992 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.792894    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-665698bb98-fth7s"]
Jun 10 10:19:34.795895 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.795871    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.798277 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798255    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 10 10:19:34.798614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798577    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 10 10:19:34.798727 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798622    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 10 10:19:34.798727 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798636    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4djr4\""
Jun 10 10:19:34.798727 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798585    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dsi9quijmjlql\""
Jun 10 10:19:34.798727 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798577    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 10 10:19:34.798974 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.798837    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 10 10:19:34.809598 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.809519    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-665698bb98-fth7s"]
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910347    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910398    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-tls\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910427    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bace15-efa3-44e9-876a-3eeee447f7c8-metrics-client-ca\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910523    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910662    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-grpc-tls\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910717    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:34.910929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:34.910768    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khnkm\" (UniqueName: \"kubernetes.io/projected/96bace15-efa3-44e9-876a-3eeee447f7c8-kube-api-access-khnkm\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.013953    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bace15-efa3-44e9-876a-3eeee447f7c8-metrics-client-ca\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014058    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014091    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-grpc-tls\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014143    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014192    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khnkm\" (UniqueName: \"kubernetes.io/projected/96bace15-efa3-44e9-876a-3eeee447f7c8-kube-api-access-khnkm\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014263    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014307    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.014838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.014361    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-tls\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.018848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.018812    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bace15-efa3-44e9-876a-3eeee447f7c8-metrics-client-ca\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.018848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.018824    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.021484 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.021456    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.022159 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.022132    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.022809 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.022753    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-grpc-tls\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.025520 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.025495    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-tls\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.027472 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.027432    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96bace15-efa3-44e9-876a-3eeee447f7c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.029539 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.029496    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khnkm\" (UniqueName: \"kubernetes.io/projected/96bace15-efa3-44e9-876a-3eeee447f7c8-kube-api-access-khnkm\") pod \"thanos-querier-665698bb98-fth7s\" (UID: \"96bace15-efa3-44e9-876a-3eeee447f7c8\") " pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.044415 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.044354    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wsx8" event={"ID":"7df52090-d79c-412b-b68e-f6c08ac097a7","Type":"ContainerStarted","Data":"36346aaa718ff0cc37f9c11afd01b843689ad1db2285ea773c40e8097f24f51c"}
Jun 10 10:19:35.048049 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.047975    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj" event={"ID":"87a28841-bbee-4ed1-84c1-cffd862a9349","Type":"ContainerStarted","Data":"e6871129695a98a678bce42a0064b70057e5e70bd8fbb1a6a430655f47782dbb"}
Jun 10 10:19:35.095948 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.095608    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:19:35.111806 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.111531    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:35.294004 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:35.293720    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-665698bb98-fth7s"]
Jun 10 10:19:35.456185 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:35.456139    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bace15_efa3_44e9_876a_3eeee447f7c8.slice/crio-cb0b2dc86c80a13994bc5596031bbda539519571d4ed6b8daea4243e78a228b9 WatchSource:0}: Error finding container cb0b2dc86c80a13994bc5596031bbda539519571d4ed6b8daea4243e78a228b9: Status 404 returned error can't find the container with id cb0b2dc86c80a13994bc5596031bbda539519571d4ed6b8daea4243e78a228b9
Jun 10 10:19:36.056673 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.056497    2552 generic.go:356] "Generic (PLEG): container finished" podID="7df52090-d79c-412b-b68e-f6c08ac097a7" containerID="36346aaa718ff0cc37f9c11afd01b843689ad1db2285ea773c40e8097f24f51c" exitCode=0
Jun 10 10:19:36.056673 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.056597    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wsx8" event={"ID":"7df52090-d79c-412b-b68e-f6c08ac097a7","Type":"ContainerDied","Data":"36346aaa718ff0cc37f9c11afd01b843689ad1db2285ea773c40e8097f24f51c"}
Jun 10 10:19:36.060409 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.060198    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj" event={"ID":"87a28841-bbee-4ed1-84c1-cffd862a9349","Type":"ContainerStarted","Data":"bdc1af7f11e4fdbabe4796269b9cc8bae3c0e16bd620d6a39e6bb867475bd495"}
Jun 10 10:19:36.060409 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.060254    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj" event={"ID":"87a28841-bbee-4ed1-84c1-cffd862a9349","Type":"ContainerStarted","Data":"83b93adc59c88a919e1bc08d0d0a93c63be1add44331b73107df9be7aa4b1e62"}
Jun 10 10:19:36.063740 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.063611    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2" event={"ID":"8f4955e0-9723-494d-bd37-2f97c08ad7f0","Type":"ContainerStarted","Data":"3a6cf4a59d67a24e3d25d02475b95072fd15ec08c14f10d94d669b0395a11cab"}
Jun 10 10:19:36.065475 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.065398    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"cb0b2dc86c80a13994bc5596031bbda539519571d4ed6b8daea4243e78a228b9"}
Jun 10 10:19:36.066938 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.066887    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"25ff9cbbde0fcb79a572e378ad14c54d97cedc4c6eae13b88ee70198a35a996e"}
Jun 10 10:19:36.096093 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.095940    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-4wwpj" podStartSLOduration=2.429987658 podStartE2EDuration="4.095901816s" totalImagesPullingTime="1.665914158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:36.09454633 +0000 UTC m=+63.951482773" watchObservedRunningTime="2026-06-10 10:19:36.095901816 +0000 UTC m=+63.952838247"
Jun 10 10:19:36.115217 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:36.115140    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fggd2" podStartSLOduration=2.648296256 podStartE2EDuration="4.115115266s" totalImagesPullingTime="1.46681901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:36.114068273 +0000 UTC m=+63.971004729" watchObservedRunningTime="2026-06-10 10:19:36.115115266 +0000 UTC m=+63.972051696"
Jun 10 10:19:37.007799 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.007376    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-666d474d9c-94865"]
Jun 10 10:19:37.011205 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.011178    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.014045 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.013825    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 10 10:19:37.015040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.014829    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-73j5mrjcjk74d\""
Jun 10 10:19:37.015040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.014895    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 10 10:19:37.015040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.014929    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 10 10:19:37.015040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.014952    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 10 10:19:37.015040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.015033    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xmhrj\""
Jun 10 10:19:37.023930 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.022128    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-666d474d9c-94865"]
Jun 10 10:19:37.074148 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.074109    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wsx8" event={"ID":"7df52090-d79c-412b-b68e-f6c08ac097a7","Type":"ContainerStarted","Data":"19966938a2923f66177a8754a2170166d9d82d2623c631f230d7c8a07f440aed"}
Jun 10 10:19:37.074594 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.074193    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wsx8" event={"ID":"7df52090-d79c-412b-b68e-f6c08ac097a7","Type":"ContainerStarted","Data":"b98ac49ce248d83c581973dcd4644e0a49a9651bf27efc50d1f89fe7e5b13c1c"}
Jun 10 10:19:37.075847 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.075818    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0" exitCode=0
Jun 10 10:19:37.075984 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.075895    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"}
Jun 10 10:19:37.093037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.092987    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8wsx8" podStartSLOduration=3.753716089 podStartE2EDuration="5.092969524s" totalImagesPullingTime="1.218131818s" totalInitContainerRuntime="121.121617ms" isStatefulPod=true podCreationTimestamp="2026-06-10 10:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:37.09197467 +0000 UTC m=+64.948911102" watchObservedRunningTime="2026-06-10 10:19:37.092969524 +0000 UTC m=+64.949905933"
Jun 10 10:19:37.142244 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.141635    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-client-ca-bundle\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.142244 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.142110    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.142244 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.142170    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-secret-metrics-server-client-certs\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.142699 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.142373    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-metrics-server-audit-profiles\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.142699 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.142598    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgqnx\" (UniqueName: \"kubernetes.io/projected/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-kube-api-access-dgqnx\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.142699 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.142693    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-secret-metrics-server-tls\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.142930 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.142738    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-audit-log\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243725 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243628    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-secret-metrics-server-tls\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243725 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243683    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-audit-log\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243777    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-client-ca-bundle\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243818    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243855    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-secret-metrics-server-client-certs\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243893    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-metrics-server-audit-profiles\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.243972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.243970    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgqnx\" (UniqueName: \"kubernetes.io/projected/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-kube-api-access-dgqnx\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.244621 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.244279    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-audit-log\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.244806 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.244774    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.245288 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.245235    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-metrics-server-audit-profiles\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.247444 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.247401    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-client-ca-bundle\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.247546 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.247477    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-secret-metrics-server-client-certs\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.248082 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.248039    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-secret-metrics-server-tls\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.252683 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.252657    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgqnx\" (UniqueName: \"kubernetes.io/projected/9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65-kube-api-access-dgqnx\") pod \"metrics-server-666d474d9c-94865\" (UID: \"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65\") " pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.326892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.326851    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:37.482493 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.482465    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-895wr"]
Jun 10 10:19:37.487134 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.487112    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:37.491119 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.490922    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 10 10:19:37.491119 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.491029    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ckrld\""
Jun 10 10:19:37.491900 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.491874    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-666d474d9c-94865"]
Jun 10 10:19:37.496716 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:37.496648    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8c36d4_47e7_4cff_bd4f_fd7b1e7fca65.slice/crio-e5d61bbcc7cbf8916125fb1c11e09bcdf4201192df5f1bd9791dbbbbc9c029fd WatchSource:0}: Error finding container e5d61bbcc7cbf8916125fb1c11e09bcdf4201192df5f1bd9791dbbbbc9c029fd: Status 404 returned error can't find the container with id e5d61bbcc7cbf8916125fb1c11e09bcdf4201192df5f1bd9791dbbbbc9c029fd
Jun 10 10:19:37.504743 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.504181    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-895wr"]
Jun 10 10:19:37.547186 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.547160    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqfpd\" (UniqueName: \"kubernetes.io/projected/9730812f-c11a-463f-8eac-37dc47820be5-kube-api-access-jqfpd\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:37.547285 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.547196    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9730812f-c11a-463f-8eac-37dc47820be5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:37.648239 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.648203    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfpd\" (UniqueName: \"kubernetes.io/projected/9730812f-c11a-463f-8eac-37dc47820be5-kube-api-access-jqfpd\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:37.648406 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.648249    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9730812f-c11a-463f-8eac-37dc47820be5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:37.648406 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:37.648369    2552 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jun 10 10:19:37.648532 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:19:37.648436    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9730812f-c11a-463f-8eac-37dc47820be5-monitoring-plugin-cert podName:9730812f-c11a-463f-8eac-37dc47820be5 nodeName:}" failed. No retries permitted until 2026-06-10 10:19:38.14841677 +0000 UTC m=+66.005353182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9730812f-c11a-463f-8eac-37dc47820be5-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-895wr" (UID: "9730812f-c11a-463f-8eac-37dc47820be5") : secret "monitoring-plugin-cert" not found
Jun 10 10:19:37.660496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.660465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqfpd\" (UniqueName: \"kubernetes.io/projected/9730812f-c11a-463f-8eac-37dc47820be5-kube-api-access-jqfpd\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:37.896676 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.896636    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68b768f76-crcl6"]
Jun 10 10:19:37.900430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.900373    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:37.904514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.903136    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 10 10:19:37.904514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.903420    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 10 10:19:37.904514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.903539    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 10 10:19:37.904514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.903783    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bwj89\""
Jun 10 10:19:37.904514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.903960    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 10 10:19:37.904514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.904029    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 10 10:19:37.909743 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.909720    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 10 10:19:37.913693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:37.913671    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68b768f76-crcl6"]
Jun 10 10:19:38.018446 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.018416    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r9sbd"
Jun 10 10:19:38.053044 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.052888    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.053711    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.053826    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-metrics-client-ca\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.053926    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-serving-certs-ca-bundle\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.054831    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-telemeter-client-tls\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.054880    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-federate-client-tls\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.054981    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-secret-telemeter-client\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.055005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.055016    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffgxj\" (UniqueName: \"kubernetes.io/projected/4d9ff042-496e-485d-a790-201bdc8b0389-kube-api-access-ffgxj\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.103371 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.103117    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"42c04cdeb0a3a8445d1bf27f9d6a6060d3622cfd6d0b5a1bc9865af271352874"}
Jun 10 10:19:38.103371 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.103253    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"c9f0abc0a357e8f669e6b9988f5a2b5633c3ad60a97d15a94e2695a77a087a23"}
Jun 10 10:19:38.103371 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.103299    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"8bd112f4cce1a52aa28e5ed1312058ecb4fc06085c7d778eb804834b85863955"}
Jun 10 10:19:38.107066 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.106687    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-666d474d9c-94865" event={"ID":"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65","Type":"ContainerStarted","Data":"e5d61bbcc7cbf8916125fb1c11e09bcdf4201192df5f1bd9791dbbbbc9c029fd"}
Jun 10 10:19:38.155935 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.155804    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-metrics-client-ca\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156025    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-serving-certs-ca-bundle\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156059    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-telemeter-client-tls\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156086    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-federate-client-tls\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156120    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9730812f-c11a-463f-8eac-37dc47820be5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:38.156268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156174    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-secret-telemeter-client\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156199    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffgxj\" (UniqueName: \"kubernetes.io/projected/4d9ff042-496e-485d-a790-201bdc8b0389-kube-api-access-ffgxj\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.156461 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.156304    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.160165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.157363    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-metrics-client-ca\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.160165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.157887    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-serving-certs-ca-bundle\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.161042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.160992    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d9ff042-496e-485d-a790-201bdc8b0389-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.173516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.163705    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.173516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.165402    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9730812f-c11a-463f-8eac-37dc47820be5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-895wr\" (UID: \"9730812f-c11a-463f-8eac-37dc47820be5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:38.173516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.165997    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-telemeter-client-tls\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.173516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.166063    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-secret-telemeter-client\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.173516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.171150    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4d9ff042-496e-485d-a790-201bdc8b0389-federate-client-tls\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.173516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.173462    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffgxj\" (UniqueName: \"kubernetes.io/projected/4d9ff042-496e-485d-a790-201bdc8b0389-kube-api-access-ffgxj\") pod \"telemeter-client-68b768f76-crcl6\" (UID: \"4d9ff042-496e-485d-a790-201bdc8b0389\") " pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.216213 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.216179    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6"
Jun 10 10:19:38.322517 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.321017    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75557655d6-zlwqk"]
Jun 10 10:19:38.326870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.325796    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.329675 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.329529    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 10 10:19:38.329828 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.329809    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2z4rl\""
Jun 10 10:19:38.330786 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.330303    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 10 10:19:38.330786 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.330530    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 10 10:19:38.330786 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.330744    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 10 10:19:38.331052 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.330949    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 10 10:19:38.342642 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.342565    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75557655d6-zlwqk"]
Jun 10 10:19:38.361181 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.360322    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:38.363214 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.363026    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 10:19:38.374042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.373984    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76422cdb-4abe-4de3-a33f-49aafeeaa38c-metrics-certs\") pod \"network-metrics-daemon-fznl8\" (UID: \"76422cdb-4abe-4de3-a33f-49aafeeaa38c\") " pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:38.405887 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.405790    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68b768f76-crcl6"]
Jun 10 10:19:38.412411 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.412231    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:38.461449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461201    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:38.461449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461263    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-oauth-serving-cert\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.461449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461317    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lt2r\" (UniqueName: \"kubernetes.io/projected/c385dd50-9d75-4347-868b-c435c7462398-kube-api-access-2lt2r\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.461449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461407    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-console-config\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.461763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461496    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-serving-cert\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.461763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461530    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-service-ca\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.461763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.461591    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-oauth-config\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.465413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.464291    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 10:19:38.474550 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.474519    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ef86f68-d30d-4000-97d6-29d744549b05-original-pull-secret\") pod \"global-pull-secret-syncer-cs4zm\" (UID: \"5ef86f68-d30d-4000-97d6-29d744549b05\") " pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:38.496205 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.496177    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n4x9s\""
Jun 10 10:19:38.500250 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.500228    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs4zm"
Jun 10 10:19:38.504471 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.504451    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fznl8"
Jun 10 10:19:38.548013 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:38.547976    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9ff042_496e_485d_a790_201bdc8b0389.slice/crio-a47c3a4a6e2e2a37facb503668594b9028b8ac361b5af6c8490645344fcc592f WatchSource:0}: Error finding container a47c3a4a6e2e2a37facb503668594b9028b8ac361b5af6c8490645344fcc592f: Status 404 returned error can't find the container with id a47c3a4a6e2e2a37facb503668594b9028b8ac361b5af6c8490645344fcc592f
Jun 10 10:19:38.562619 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.562592    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-console-config\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.562816 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.562642    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-serving-cert\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.562816 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.562671    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-service-ca\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.563710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.563025    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:38.563710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.563065    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-oauth-config\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.563710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.563113    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-oauth-serving-cert\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.563710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.563161    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lt2r\" (UniqueName: \"kubernetes.io/projected/c385dd50-9d75-4347-868b-c435c7462398-kube-api-access-2lt2r\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.563710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.563426    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-console-config\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.563710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.563464    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-service-ca\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.564097 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.564038    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-oauth-serving-cert\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.565821 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.565636    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 10:19:38.567331 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.567304    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-oauth-config\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.567437 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.567393    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-serving-cert\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.571732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.571706    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lt2r\" (UniqueName: \"kubernetes.io/projected/c385dd50-9d75-4347-868b-c435c7462398-kube-api-access-2lt2r\") pod \"console-75557655d6-zlwqk\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") " pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.576893 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.576659    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 10:19:38.587748 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.587724    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92hcd\" (UniqueName: \"kubernetes.io/projected/5e32543a-b771-4347-86c9-a65ac22df508-kube-api-access-92hcd\") pod \"network-check-target-jcnpv\" (UID: \"5e32543a-b771-4347-86c9-a65ac22df508\") " pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:38.643064 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.642995    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:38.808784 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.808700    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cb5mx\""
Jun 10 10:19:38.816110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.816073    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:38.977656 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.977619    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:19:38.983940 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.983323    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.986956    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.987181    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.987222    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9jtj2\""
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.987353    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.987407    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.987566    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 10 10:19:38.987665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.987580    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.988575    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.988731    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.988991    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.989177    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.989590    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pe7lepc92ola\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.989722    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 10 10:19:38.990298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.989898    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 10 10:19:38.993241 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.992988    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 10 10:19:38.995481 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:38.995380    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 10 10:19:39.002979 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.002837    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:19:39.070800 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.070710    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.070800 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.070775    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.072880 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.072848    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.072918    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.072946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76mkb\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-kube-api-access-76mkb\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.072988    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-config\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073016    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073049    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073071    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073108    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073124    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073148    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073498 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073225    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073498 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073265    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-config-out\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073498 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073498 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073381    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073678 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073491    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073678 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073539    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-web-config\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.073678 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.073572    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.113357 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.113318    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6" event={"ID":"4d9ff042-496e-485d-a790-201bdc8b0389","Type":"ContainerStarted","Data":"a47c3a4a6e2e2a37facb503668594b9028b8ac361b5af6c8490645344fcc592f"}
Jun 10 10:19:39.174823 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.174780    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.174851    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.174882    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.174933    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.174957    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76mkb\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-kube-api-access-76mkb\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.174987    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-config\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175015    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175046    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175070    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175112    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175138    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175167    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175215    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175243    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175301    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-config-out\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175326    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175771 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175354    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175771 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175389    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175771 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175412    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-web-config\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.175771 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175435    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.176022 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.175993    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.176371 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.176349    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.177074 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.177048    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.177074 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.177062    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.178209 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.177708    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.178209 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.177983    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.182432 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.182405    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-config-out\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.183479 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.182807    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.183479 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.182979    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-config\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.183479 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.183302    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.184251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.183851    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.185382 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.184760    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.188516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.188487    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.189105 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.189081    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.191682 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.191635    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-web-config\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.192053 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.192031    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.192852 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.192829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.196011 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.195893    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.196255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.196162    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.199989 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.199932    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76mkb\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-kube-api-access-76mkb\") pod \"prometheus-k8s-0\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:39.299390 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:39.299253    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:40.062541 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.062427    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cs4zm"]
Jun 10 10:19:40.087334 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.087267    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jcnpv"]
Jun 10 10:19:40.100630 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.097627    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fznl8"]
Jun 10 10:19:40.100630 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.099403    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75557655d6-zlwqk"]
Jun 10 10:19:40.100630 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:40.100045    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76422cdb_4abe_4de3_a33f_49aafeeaa38c.slice/crio-97bbf3017a0efe031e5823ae338d6857ca8f14d2d67835e05fd7cf63690d6f18 WatchSource:0}: Error finding container 97bbf3017a0efe031e5823ae338d6857ca8f14d2d67835e05fd7cf63690d6f18: Status 404 returned error can't find the container with id 97bbf3017a0efe031e5823ae338d6857ca8f14d2d67835e05fd7cf63690d6f18
Jun 10 10:19:40.102797 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:40.102753    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc385dd50_9d75_4347_868b_c435c7462398.slice/crio-8ce9dfad6077e52a370b645c25a16d69a2826c6e23e7e0120c2cfe4ef18c0da9 WatchSource:0}: Error finding container 8ce9dfad6077e52a370b645c25a16d69a2826c6e23e7e0120c2cfe4ef18c0da9: Status 404 returned error can't find the container with id 8ce9dfad6077e52a370b645c25a16d69a2826c6e23e7e0120c2cfe4ef18c0da9
Jun 10 10:19:40.128741 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.128273    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75557655d6-zlwqk" event={"ID":"c385dd50-9d75-4347-868b-c435c7462398","Type":"ContainerStarted","Data":"8ce9dfad6077e52a370b645c25a16d69a2826c6e23e7e0120c2cfe4ef18c0da9"}
Jun 10 10:19:40.133887 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.133816    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cs4zm" event={"ID":"5ef86f68-d30d-4000-97d6-29d744549b05","Type":"ContainerStarted","Data":"5cf9573476f49192bc6a1fef576a734ebd94e6a8a5ce7ca9d8d679a6253302ed"}
Jun 10 10:19:40.136869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.136828    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jcnpv" event={"ID":"5e32543a-b771-4347-86c9-a65ac22df508","Type":"ContainerStarted","Data":"095f652dcc5cc15b0b4d689c0decc0989d6ccbeed8bd835f1be676a94c00888b"}
Jun 10 10:19:40.143176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.143107    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"5b7b9db5cc0544159307519802f210daaf094afe68d3d404d3468563b79fdcef"}
Jun 10 10:19:40.148641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.148545    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"}
Jun 10 10:19:40.153740 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.152897    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-666d474d9c-94865" event={"ID":"9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65","Type":"ContainerStarted","Data":"c4f9a1b586b3dbb581ed5343c2d2b3339e9586afe83fd26a38330e9d19c303eb"}
Jun 10 10:19:40.155037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.154971    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fznl8" event={"ID":"76422cdb-4abe-4de3-a33f-49aafeeaa38c","Type":"ContainerStarted","Data":"97bbf3017a0efe031e5823ae338d6857ca8f14d2d67835e05fd7cf63690d6f18"}
Jun 10 10:19:40.172658 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.172604    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-666d474d9c-94865" podStartSLOduration=1.91843714 podStartE2EDuration="4.172581314s" totalImagesPullingTime="2.254144174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:40.169883097 +0000 UTC m=+68.026819566" watchObservedRunningTime="2026-06-10 10:19:40.172581314 +0000 UTC m=+68.029517747"
Jun 10 10:19:40.324333 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.324265    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-895wr"]
Jun 10 10:19:40.339549 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:40.339171    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:19:40.345287 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:19:40.345257    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6071abee_fbe8_4b42_bb0a_7d4412873980.slice/crio-3c462ac430a2dc4e0bbdd39a848cabe725c60216a85083802301a12cd3397f9e WatchSource:0}: Error finding container 3c462ac430a2dc4e0bbdd39a848cabe725c60216a85083802301a12cd3397f9e: Status 404 returned error can't find the container with id 3c462ac430a2dc4e0bbdd39a848cabe725c60216a85083802301a12cd3397f9e
Jun 10 10:19:41.166315 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.166168    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"27231bcb6f36ff862ce0fcbd4013de60271f7e0fe5a4bbef4a71c9c8344497b5"}
Jun 10 10:19:41.166315 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.166250    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" event={"ID":"96bace15-efa3-44e9-876a-3eeee447f7c8","Type":"ContainerStarted","Data":"9416a61534a077b71914875add00f6021e200e08cc2d7293e7e21dcf5fa0611e"}
Jun 10 10:19:41.166971 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.166877    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:41.183207 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.183164    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"}
Jun 10 10:19:41.183388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.183307    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"}
Jun 10 10:19:41.183388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.183367    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"}
Jun 10 10:19:41.183483 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.183424    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"}
Jun 10 10:19:41.187079 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.186901    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"df5e93944ddb5d787bd8abc7440b4bacec5770456a9d6f6089fc7db496a217e3"}
Jun 10 10:19:41.187079 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.186999    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"3c462ac430a2dc4e0bbdd39a848cabe725c60216a85083802301a12cd3397f9e"}
Jun 10 10:19:41.188923 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.188853    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr" event={"ID":"9730812f-c11a-463f-8eac-37dc47820be5","Type":"ContainerStarted","Data":"6015fa765cf2677714c4528796aa2995939b0807d4aab739499072a9737a89dd"}
Jun 10 10:19:41.198317 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:41.197266    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s" podStartSLOduration=3.155184827 podStartE2EDuration="7.197246176s" totalImagesPullingTime="4.042061349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:41.195372215 +0000 UTC m=+69.052308658" watchObservedRunningTime="2026-06-10 10:19:41.197246176 +0000 UTC m=+69.054182622"
Jun 10 10:19:42.203032 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.201598    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="df5e93944ddb5d787bd8abc7440b4bacec5770456a9d6f6089fc7db496a217e3" exitCode=0
Jun 10 10:19:42.203032 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.201749    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"df5e93944ddb5d787bd8abc7440b4bacec5770456a9d6f6089fc7db496a217e3"}
Jun 10 10:19:42.215237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.215013    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6" event={"ID":"4d9ff042-496e-485d-a790-201bdc8b0389","Type":"ContainerStarted","Data":"ba07cbdd0cde8dacd573bb37c173f32d45f0ebe8368fb1346a8c3603d64cc862"}
Jun 10 10:19:42.215237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.215090    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6" event={"ID":"4d9ff042-496e-485d-a790-201bdc8b0389","Type":"ContainerStarted","Data":"905ea09837b85055cf1fb95897615409ef838365da4793e0d460c548c8522330"}
Jun 10 10:19:42.215237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.215116    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6" event={"ID":"4d9ff042-496e-485d-a790-201bdc8b0389","Type":"ContainerStarted","Data":"e450ed6980590b8fbf8c9e0c0dc34a1f21c17b5d4a0bb3cb87c1c9f7342bf52c"}
Jun 10 10:19:42.232025 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.231926    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerStarted","Data":"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"}
Jun 10 10:19:42.239308 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.239217    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-665698bb98-fth7s"
Jun 10 10:19:42.267527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.267462    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.30206701 podStartE2EDuration="9.267439544s" totalImagesPullingTime="3.94440755s" totalInitContainerRuntime="20.964984ms" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:42.266481624 +0000 UTC m=+70.123418087" watchObservedRunningTime="2026-06-10 10:19:42.267439544 +0000 UTC m=+70.124375977"
Jun 10 10:19:42.296224 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:42.295014    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68b768f76-crcl6" podStartSLOduration=2.168894988 podStartE2EDuration="5.294991064s" totalImagesPullingTime="3.126096076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:42.292753192 +0000 UTC m=+70.149689614" watchObservedRunningTime="2026-06-10 10:19:42.294991064 +0000 UTC m=+70.151927497"
Jun 10 10:19:57.319557 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.319510    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75557655d6-zlwqk" event={"ID":"c385dd50-9d75-4347-868b-c435c7462398","Type":"ContainerStarted","Data":"94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0"}
Jun 10 10:19:57.321315 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.321288    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jcnpv" event={"ID":"5e32543a-b771-4347-86c9-a65ac22df508","Type":"ContainerStarted","Data":"7a026c7a3894e8499c3169c885eafbe7d2176ac5aefd75ae7eb4c2dc4a1bca0e"}
Jun 10 10:19:57.321452 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.321424    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:19:57.323358 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.323266    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fznl8" event={"ID":"76422cdb-4abe-4de3-a33f-49aafeeaa38c","Type":"ContainerStarted","Data":"e8489b829ac1fb1c67261f7c4c53ef7c84895e87998e17b765e3fd210e5bdeec"}
Jun 10 10:19:57.325147 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.325120    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr" event={"ID":"9730812f-c11a-463f-8eac-37dc47820be5","Type":"ContainerStarted","Data":"80865f64773fc72f342e27bd906866e9761ab44f9a3d8d3e9bc9d8ba9c554d26"}
Jun 10 10:19:57.325469 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.325320    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:57.327056 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.326876    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-5xd68" event={"ID":"71657fc6-205f-46c9-b110-4564cd3fc7db","Type":"ContainerStarted","Data":"43a37beeac45cf0a1450aa1dd7f03b4f3ef43a475c20913cbb678b32accbbbf7"}
Jun 10 10:19:57.327056 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.326950    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:57.332723 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.327366    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:19:57.332723 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.328735    2552 patch_prober.go:28] interesting pod/downloads-6657875f97-5xd68 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body=
Jun 10 10:19:57.332723 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.328820    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-5xd68" podUID="71657fc6-205f-46c9-b110-4564cd3fc7db" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused"
Jun 10 10:19:57.332723 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.331840    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:57.333102 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.332813    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr"
Jun 10 10:19:57.337248 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.337221    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cs4zm" event={"ID":"5ef86f68-d30d-4000-97d6-29d744549b05","Type":"ContainerStarted","Data":"975c1cea106d74e9f54ec9453a059146f664332090fbc42a3b7532ce5378694d"}
Jun 10 10:19:57.366917 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.366835    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75557655d6-zlwqk" podStartSLOduration=2.6335723079999998 podStartE2EDuration="19.366814416s" totalImagesPullingTime="16.733242108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:57.358865967 +0000 UTC m=+85.215802399" watchObservedRunningTime="2026-06-10 10:19:57.366814416 +0000 UTC m=+85.223750848"
Jun 10 10:19:57.397704 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.397649    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-895wr" podStartSLOduration=3.8980976370000002 podStartE2EDuration="20.397630863s" totalImagesPullingTime="16.499533226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:57.39511226 +0000 UTC m=+85.252048692" watchObservedRunningTime="2026-06-10 10:19:57.397630863 +0000 UTC m=+85.254567285"
Jun 10 10:19:57.424371 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.423340    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jcnpv" podStartSLOduration=68.694243083 podStartE2EDuration="1m25.423317366s" totalImagesPullingTime="16.729074283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:57.419897938 +0000 UTC m=+85.276834385" watchObservedRunningTime="2026-06-10 10:19:57.423317366 +0000 UTC m=+85.280253800"
Jun 10 10:19:57.444981 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.444897    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cs4zm" podStartSLOduration=68.684110856 podStartE2EDuration="1m25.444872471s" totalImagesPullingTime="16.760761615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:57.444813175 +0000 UTC m=+85.301749608" watchObservedRunningTime="2026-06-10 10:19:57.444872471 +0000 UTC m=+85.301808905"
Jun 10 10:19:57.466437 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:57.466377    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-5xd68" podStartSLOduration=2.611885385 podStartE2EDuration="30.466358466s" totalImagesPullingTime="27.854473081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:57.464712243 +0000 UTC m=+85.321648806" watchObservedRunningTime="2026-06-10 10:19:57.466358466 +0000 UTC m=+85.323294894"
Jun 10 10:19:58.347103 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.347017    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fznl8" event={"ID":"76422cdb-4abe-4de3-a33f-49aafeeaa38c","Type":"ContainerStarted","Data":"bbccba267e5aea5883275c7ae45ed492b6279495370a141ad5fe7d8ea9a3ca0d"}
Jun 10 10:19:58.351860 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.351826    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"cbc964f73a3585e74605a297c8269cf0bffbb1bf00ec4f5a72a840cfc39c63a3"}
Jun 10 10:19:58.352021 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.351926    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"9530c3eb2b967f83d1f9b2365bdeaab30de88becc8c45bd86ef73775587a8c63"}
Jun 10 10:19:58.352021 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.351975    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"1456ae4aec123201465121e3be437791a5adfbc953d85159753cec917992d113"}
Jun 10 10:19:58.352021 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.352008    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"249623e1d511ccaaaf3b9b7bd731615723d5fa0e42baa430cd543a69577eed77"}
Jun 10 10:19:58.352200 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.352048    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"f23197bdf91a6c1c931d154fb1b3929b22a9af226911fcd70bd6a5755776be3c"}
Jun 10 10:19:58.352200 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.352162    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerStarted","Data":"dec24a621f4e1e3132b4dec9cf1955729573c50cc55b07b89cfd92655fca7ddb"}
Jun 10 10:19:58.355106 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.355082    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75557655d6-zlwqk"]
Jun 10 10:19:58.356497 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.356472    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-5xd68"
Jun 10 10:19:58.370490 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.370385    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fznl8" podStartSLOduration=69.681929206 podStartE2EDuration="1m26.370365122s" totalImagesPullingTime="16.688435916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:58.370173879 +0000 UTC m=+86.227110313" watchObservedRunningTime="2026-06-10 10:19:58.370365122 +0000 UTC m=+86.227301554"
Jun 10 10:19:58.402666 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.402596    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.411217239 podStartE2EDuration="20.402571625s" totalImagesPullingTime="14.966847168s" totalInitContainerRuntime="24.507218ms" isStatefulPod=false podCreationTimestamp="2026-06-10 10:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:19:58.400223923 +0000 UTC m=+86.257160378" watchObservedRunningTime="2026-06-10 10:19:58.402571625 +0000 UTC m=+86.259508057"
Jun 10 10:19:58.643701 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.643648    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:58.643902 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.643724    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:58.649793 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:58.649758    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:19:59.299440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:59.299400    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:19:59.369976 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:19:59.369943    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:20:17.333262 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:17.333222    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:20:17.337135 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:17.337109    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-666d474d9c-94865"
Jun 10 10:20:24.390155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.390087    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75557655d6-zlwqk" podUID="c385dd50-9d75-4347-868b-c435c7462398" containerName="console" containerID="cri-o://94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0" gracePeriod=15
Jun 10 10:20:24.634303 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.634273    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:20:24.721569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.721484    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-oauth-config\") pod \"c385dd50-9d75-4347-868b-c435c7462398\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") "
Jun 10 10:20:24.721569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.721528    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-serving-cert\") pod \"c385dd50-9d75-4347-868b-c435c7462398\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") "
Jun 10 10:20:24.721569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.721567    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-console-config\") pod \"c385dd50-9d75-4347-868b-c435c7462398\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") "
Jun 10 10:20:24.721807 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.721600    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-oauth-serving-cert\") pod \"c385dd50-9d75-4347-868b-c435c7462398\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") "
Jun 10 10:20:24.721807 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.721656    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-service-ca\") pod \"c385dd50-9d75-4347-868b-c435c7462398\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") "
Jun 10 10:20:24.721807 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.721700    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lt2r\" (UniqueName: \"kubernetes.io/projected/c385dd50-9d75-4347-868b-c435c7462398-kube-api-access-2lt2r\") pod \"c385dd50-9d75-4347-868b-c435c7462398\" (UID: \"c385dd50-9d75-4347-868b-c435c7462398\") "
Jun 10 10:20:24.722060 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.722023    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-console-config" (OuterVolumeSpecName: "console-config") pod "c385dd50-9d75-4347-868b-c435c7462398" (UID: "c385dd50-9d75-4347-868b-c435c7462398"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:24.722177 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.722072    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c385dd50-9d75-4347-868b-c435c7462398" (UID: "c385dd50-9d75-4347-868b-c435c7462398"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:24.722177 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.722138    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-service-ca" (OuterVolumeSpecName: "service-ca") pod "c385dd50-9d75-4347-868b-c435c7462398" (UID: "c385dd50-9d75-4347-868b-c435c7462398"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:24.724122 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.724096    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c385dd50-9d75-4347-868b-c435c7462398" (UID: "c385dd50-9d75-4347-868b-c435c7462398"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:24.724213 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.724181    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c385dd50-9d75-4347-868b-c435c7462398-kube-api-access-2lt2r" (OuterVolumeSpecName: "kube-api-access-2lt2r") pod "c385dd50-9d75-4347-868b-c435c7462398" (UID: "c385dd50-9d75-4347-868b-c435c7462398"). InnerVolumeSpecName "kube-api-access-2lt2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:20:24.724213 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.724186    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c385dd50-9d75-4347-868b-c435c7462398" (UID: "c385dd50-9d75-4347-868b-c435c7462398"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:24.822794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.822752    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-oauth-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:24.822794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.822785    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c385dd50-9d75-4347-868b-c435c7462398-console-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:24.822794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.822795    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-console-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:24.822794 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.822804    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-oauth-serving-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:24.823093 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.822813    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c385dd50-9d75-4347-868b-c435c7462398-service-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:24.823093 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:24.822822    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lt2r\" (UniqueName: \"kubernetes.io/projected/c385dd50-9d75-4347-868b-c435c7462398-kube-api-access-2lt2r\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:25.479739 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.479693    2552 generic.go:356] "Generic (PLEG): container finished" podID="c385dd50-9d75-4347-868b-c435c7462398" containerID="94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0" exitCode=0
Jun 10 10:20:25.479739 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.479727    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75557655d6-zlwqk" event={"ID":"c385dd50-9d75-4347-868b-c435c7462398","Type":"ContainerDied","Data":"94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0"}
Jun 10 10:20:25.480274 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.479739    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75557655d6-zlwqk"
Jun 10 10:20:25.480274 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.479853    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75557655d6-zlwqk" event={"ID":"c385dd50-9d75-4347-868b-c435c7462398","Type":"ContainerDied","Data":"8ce9dfad6077e52a370b645c25a16d69a2826c6e23e7e0120c2cfe4ef18c0da9"}
Jun 10 10:20:25.480274 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.479887    2552 scope.go:117] "RemoveContainer" containerID="94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0"
Jun 10 10:20:25.489058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.489042    2552 scope.go:117] "RemoveContainer" containerID="94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0"
Jun 10 10:20:25.489340 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:25.489320    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0\": container with ID starting with 94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0 not found: ID does not exist" containerID="94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0"
Jun 10 10:20:25.489391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.489348    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0"} err="failed to get container status \"94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0\": rpc error: code = NotFound desc = could not find container \"94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0\": container with ID starting with 94c23d14701c1cd661e9fc7800ab3a285da9e759dc1b6fa9ed08ecc8072ec3a0 not found: ID does not exist"
Jun 10 10:20:25.503587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.503560    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75557655d6-zlwqk"]
Jun 10 10:20:25.509171 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:25.509148    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75557655d6-zlwqk"]
Jun 10 10:20:26.579669 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:26.579638    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c385dd50-9d75-4347-868b-c435c7462398" path="/var/lib/kubelet/pods/c385dd50-9d75-4347-868b-c435c7462398/volumes"
Jun 10 10:20:28.355971 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:28.355945    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jcnpv"
Jun 10 10:20:39.299874 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:39.299833    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:39.338516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:39.338475    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:39.556263 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:39.556187    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:53.116453 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116415    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:20:53.116966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116707    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="alertmanager" containerID="cri-o://b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22" gracePeriod=120
Jun 10 10:20:53.116966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116775    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-metric" containerID="cri-o://d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5" gracePeriod=120
Jun 10 10:20:53.116966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116791    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-web" containerID="cri-o://7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca" gracePeriod=120
Jun 10 10:20:53.116966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116808    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="config-reloader" containerID="cri-o://fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6" gracePeriod=120
Jun 10 10:20:53.116966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116850    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="prom-label-proxy" containerID="cri-o://2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b" gracePeriod=120
Jun 10 10:20:53.116966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.116869    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy" containerID="cri-o://685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941" gracePeriod=120
Jun 10 10:20:53.606172 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606143    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b" exitCode=0
Jun 10 10:20:53.606172 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606171    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941" exitCode=0
Jun 10 10:20:53.606347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606177    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6" exitCode=0
Jun 10 10:20:53.606347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606183    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22" exitCode=0
Jun 10 10:20:53.606347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606215    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"}
Jun 10 10:20:53.606347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606296    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"}
Jun 10 10:20:53.606347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606321    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"}
Jun 10 10:20:53.606347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:53.606345    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"}
Jun 10 10:20:54.365744 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.365720    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.493938 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.493829    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-metrics-client-ca\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.493938 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.493880    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-trusted-ca-bundle\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.493945    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-web\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.493992    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494045    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-main-db\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494068    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-tls-assets\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494105    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494132    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-web-config\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494154    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-config-out\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494220    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494249    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzx2m\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-kube-api-access-nzx2m\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494289    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-config-volume\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494303    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494324    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-cluster-tls-config\") pod \"4b07f540-a7bf-484a-a265-3abc7f286d93\" (UID: \"4b07f540-a7bf-484a-a265-3abc7f286d93\") "
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494354    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:54.494440 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494391    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:20:54.494853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494637    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-metrics-client-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.494853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494666    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.494853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.494680    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-alertmanager-main-db\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.497134 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.497103    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.497424 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.497404    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-config-out" (OuterVolumeSpecName: "config-out") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:20:54.497424 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.497412    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:20:54.497749 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.497708    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.497862 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.497790    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.498170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.498141    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-config-volume" (OuterVolumeSpecName: "config-volume") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.498255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.498199    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-kube-api-access-nzx2m" (OuterVolumeSpecName: "kube-api-access-nzx2m") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "kube-api-access-nzx2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:20:54.498599 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.498580    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.502754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.502638    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.508985 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.508964    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-web-config" (OuterVolumeSpecName: "web-config") pod "4b07f540-a7bf-484a-a265-3abc7f286d93" (UID: "4b07f540-a7bf-484a-a265-3abc7f286d93"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:54.595410 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595381    2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-tls-assets\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595410 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595411    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-main-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595424    2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-web-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595436    2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b07f540-a7bf-484a-a265-3abc7f286d93-config-out\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595448    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595463    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzx2m\" (UniqueName: \"kubernetes.io/projected/4b07f540-a7bf-484a-a265-3abc7f286d93-kube-api-access-nzx2m\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595475    2552 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-config-volume\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595487    2552 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-cluster-tls-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595499    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.595589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.595512    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b07f540-a7bf-484a-a265-3abc7f286d93-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:54.613982 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.613953    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5" exitCode=0
Jun 10 10:20:54.613982 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.613977    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerID="7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca" exitCode=0
Jun 10 10:20:54.614152 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.614023    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"}
Jun 10 10:20:54.614152 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.614037    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.614152 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.614079    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"}
Jun 10 10:20:54.614152 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.614105    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b07f540-a7bf-484a-a265-3abc7f286d93","Type":"ContainerDied","Data":"25ff9cbbde0fcb79a572e378ad14c54d97cedc4c6eae13b88ee70198a35a996e"}
Jun 10 10:20:54.614152 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.614134    2552 scope.go:117] "RemoveContainer" containerID="2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"
Jun 10 10:20:54.621923 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.621888    2552 scope.go:117] "RemoveContainer" containerID="d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"
Jun 10 10:20:54.628608 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.628588    2552 scope.go:117] "RemoveContainer" containerID="685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"
Jun 10 10:20:54.635247 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.635230    2552 scope.go:117] "RemoveContainer" containerID="7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"
Jun 10 10:20:54.643162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.643072    2552 scope.go:117] "RemoveContainer" containerID="fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"
Jun 10 10:20:54.644560 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.644542    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:20:54.645983 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.645962    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:20:54.651119 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.651101    2552 scope.go:117] "RemoveContainer" containerID="b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"
Jun 10 10:20:54.657948 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.657934    2552 scope.go:117] "RemoveContainer" containerID="9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"
Jun 10 10:20:54.664780 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.664764    2552 scope.go:117] "RemoveContainer" containerID="2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"
Jun 10 10:20:54.665055 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.665037    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b\": container with ID starting with 2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b not found: ID does not exist" containerID="2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"
Jun 10 10:20:54.665110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665063    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"} err="failed to get container status \"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b\": rpc error: code = NotFound desc = could not find container \"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b\": container with ID starting with 2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b not found: ID does not exist"
Jun 10 10:20:54.665110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665081    2552 scope.go:117] "RemoveContainer" containerID="d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"
Jun 10 10:20:54.665341 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.665319    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5\": container with ID starting with d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5 not found: ID does not exist" containerID="d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"
Jun 10 10:20:54.665397 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665350    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"} err="failed to get container status \"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5\": rpc error: code = NotFound desc = could not find container \"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5\": container with ID starting with d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5 not found: ID does not exist"
Jun 10 10:20:54.665397 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665369    2552 scope.go:117] "RemoveContainer" containerID="685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"
Jun 10 10:20:54.665605 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.665587    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941\": container with ID starting with 685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941 not found: ID does not exist" containerID="685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"
Jun 10 10:20:54.665653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665611    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"} err="failed to get container status \"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941\": rpc error: code = NotFound desc = could not find container \"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941\": container with ID starting with 685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941 not found: ID does not exist"
Jun 10 10:20:54.665653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665631    2552 scope.go:117] "RemoveContainer" containerID="7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"
Jun 10 10:20:54.665866 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.665851    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca\": container with ID starting with 7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca not found: ID does not exist" containerID="7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"
Jun 10 10:20:54.665926 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665870    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"} err="failed to get container status \"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca\": rpc error: code = NotFound desc = could not find container \"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca\": container with ID starting with 7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca not found: ID does not exist"
Jun 10 10:20:54.665926 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.665883    2552 scope.go:117] "RemoveContainer" containerID="fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"
Jun 10 10:20:54.666102 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.666088    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6\": container with ID starting with fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6 not found: ID does not exist" containerID="fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"
Jun 10 10:20:54.666147 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666104    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"} err="failed to get container status \"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6\": rpc error: code = NotFound desc = could not find container \"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6\": container with ID starting with fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6 not found: ID does not exist"
Jun 10 10:20:54.666147 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666117    2552 scope.go:117] "RemoveContainer" containerID="b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"
Jun 10 10:20:54.666350 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.666334    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22\": container with ID starting with b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22 not found: ID does not exist" containerID="b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"
Jun 10 10:20:54.666387 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666355    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"} err="failed to get container status \"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22\": rpc error: code = NotFound desc = could not find container \"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22\": container with ID starting with b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22 not found: ID does not exist"
Jun 10 10:20:54.666387 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666376    2552 scope.go:117] "RemoveContainer" containerID="9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"
Jun 10 10:20:54.666593 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:20:54.666575    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0\": container with ID starting with 9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0 not found: ID does not exist" containerID="9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"
Jun 10 10:20:54.666637 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666598    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"} err="failed to get container status \"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0\": rpc error: code = NotFound desc = could not find container \"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0\": container with ID starting with 9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0 not found: ID does not exist"
Jun 10 10:20:54.666637 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666613    2552 scope.go:117] "RemoveContainer" containerID="2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"
Jun 10 10:20:54.666891 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666866    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b"} err="failed to get container status \"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b\": rpc error: code = NotFound desc = could not find container \"2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b\": container with ID starting with 2441c544e7435f68ddd1ad841737559b89f73248406c5ff6e6d918a9d93ab65b not found: ID does not exist"
Jun 10 10:20:54.666891 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.666892    2552 scope.go:117] "RemoveContainer" containerID="d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"
Jun 10 10:20:54.667233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.667212    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5"} err="failed to get container status \"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5\": rpc error: code = NotFound desc = could not find container \"d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5\": container with ID starting with d506ea11226d36b00de93a10073cd9d6c7f8409400b1b769e1938d8497630ec5 not found: ID does not exist"
Jun 10 10:20:54.667233 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.667231    2552 scope.go:117] "RemoveContainer" containerID="685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"
Jun 10 10:20:54.667509 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.667451    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941"} err="failed to get container status \"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941\": rpc error: code = NotFound desc = could not find container \"685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941\": container with ID starting with 685b0c3b943463911b0b20e7c7dd4ed56ad3bd03fd87c5c5f7f3913b3fae7941 not found: ID does not exist"
Jun 10 10:20:54.667509 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.667472    2552 scope.go:117] "RemoveContainer" containerID="7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"
Jun 10 10:20:54.667718 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.667698    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca"} err="failed to get container status \"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca\": rpc error: code = NotFound desc = could not find container \"7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca\": container with ID starting with 7ed9ba697589ab32016665a0ae1d68c0f6afaf3472811bb4689228b8bc8125ca not found: ID does not exist"
Jun 10 10:20:54.667846 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.667717    2552 scope.go:117] "RemoveContainer" containerID="fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"
Jun 10 10:20:54.668200 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.668008    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6"} err="failed to get container status \"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6\": rpc error: code = NotFound desc = could not find container \"fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6\": container with ID starting with fe457148d271722eee6690cac228fea2fb62454a7264d080f8fb3594b2650de6 not found: ID does not exist"
Jun 10 10:20:54.668200 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.668033    2552 scope.go:117] "RemoveContainer" containerID="b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"
Jun 10 10:20:54.668330 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.668301    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22"} err="failed to get container status \"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22\": rpc error: code = NotFound desc = could not find container \"b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22\": container with ID starting with b27976a4a6ae4623e39e4f08b4ef1bbe65ff6a95b61cf75d83bb49210c7ccb22 not found: ID does not exist"
Jun 10 10:20:54.668416 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.668331    2552 scope.go:117] "RemoveContainer" containerID="9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"
Jun 10 10:20:54.668587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.668569    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0"} err="failed to get container status \"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0\": rpc error: code = NotFound desc = could not find container \"9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0\": container with ID starting with 9b22a51c1289a6addf3660e5588d3dbe322c33d100c604af65fff4e51ae74bf0 not found: ID does not exist"
Jun 10 10:20:54.684352 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684329    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:20:54.684766 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684752    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c385dd50-9d75-4347-868b-c435c7462398" containerName="console"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684769    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c385dd50-9d75-4347-868b-c435c7462398" containerName="console"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684782    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-metric"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684789    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-metric"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684797    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684803    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684810    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="prom-label-proxy"
Jun 10 10:20:54.684817 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684815    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="prom-label-proxy"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684826    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-web"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684832    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-web"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684846    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="config-reloader"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684852    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="config-reloader"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684858    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="init-config-reloader"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684869    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="init-config-reloader"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684875    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="alertmanager"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684880    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="alertmanager"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684968    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="prom-label-proxy"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684977    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c385dd50-9d75-4347-868b-c435c7462398" containerName="console"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684988    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="alertmanager"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.684994    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="config-reloader"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.685001    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-metric"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.685007    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy"
Jun 10 10:20:54.685037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.685015    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" containerName="kube-rbac-proxy-web"
Jun 10 10:20:54.689268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.689252    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.693942 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.693898    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 10 10:20:54.694030 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.693988    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 10 10:20:54.694030 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694009    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 10 10:20:54.694150 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694142    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 10 10:20:54.694235 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694219    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 10 10:20:54.694291 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694259    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 10 10:20:54.694405 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694388    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vtv9z\""
Jun 10 10:20:54.694782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694744    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 10 10:20:54.694782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.694764    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 10 10:20:54.709380 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.709358    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 10 10:20:54.726473 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.726445    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:20:54.796611 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796518    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796611 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796555    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-web-config\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796611 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796577    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796629    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b81f4e83-c35a-4055-aa9c-ab225281e2e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796670    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796732    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b81f4e83-c35a-4055-aa9c-ab225281e2e5-config-out\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b81f4e83-c35a-4055-aa9c-ab225281e2e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796770    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81f4e83-c35a-4055-aa9c-ab225281e2e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.796849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796807    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.797100 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796852    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.797100 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b81f4e83-c35a-4055-aa9c-ab225281e2e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.797100 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.796986    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.797100 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.797003    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldcl8\" (UniqueName: \"kubernetes.io/projected/b81f4e83-c35a-4055-aa9c-ab225281e2e5-kube-api-access-ldcl8\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.898318 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898285    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.898473 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898326    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.898514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898459    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b81f4e83-c35a-4055-aa9c-ab225281e2e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.898565 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898549    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.898600 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898577    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldcl8\" (UniqueName: \"kubernetes.io/projected/b81f4e83-c35a-4055-aa9c-ab225281e2e5-kube-api-access-ldcl8\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.898641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898831    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-web-config\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898872    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898835    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b81f4e83-c35a-4055-aa9c-ab225281e2e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.898924    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b81f4e83-c35a-4055-aa9c-ab225281e2e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.899003    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899374 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.899074    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b81f4e83-c35a-4055-aa9c-ab225281e2e5-config-out\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899374 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.899105    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b81f4e83-c35a-4055-aa9c-ab225281e2e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.899374 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.899132    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81f4e83-c35a-4055-aa9c-ab225281e2e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.900223 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.900194    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81f4e83-c35a-4055-aa9c-ab225281e2e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.901479 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.901455    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.901629 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.901608    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.901714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.901613    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.901714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.901696    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b81f4e83-c35a-4055-aa9c-ab225281e2e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.901828 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.901700    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.901978 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.901960    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-web-config\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.902309 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.902289    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b81f4e83-c35a-4055-aa9c-ab225281e2e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.902581 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.902562    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.902704 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.902681    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b81f4e83-c35a-4055-aa9c-ab225281e2e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.903372 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.903352    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b81f4e83-c35a-4055-aa9c-ab225281e2e5-config-out\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.906686 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.906669    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldcl8\" (UniqueName: \"kubernetes.io/projected/b81f4e83-c35a-4055-aa9c-ab225281e2e5-kube-api-access-ldcl8\") pod \"alertmanager-main-0\" (UID: \"b81f4e83-c35a-4055-aa9c-ab225281e2e5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:54.998261 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:54.998221    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 10:20:55.159898 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:55.159866    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 10:20:55.163069 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:20:55.163035    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81f4e83_c35a_4055_aa9c_ab225281e2e5.slice/crio-6abb09fe3c2709b039d7489e5a3faf96702eadbf36c98f460a35fc58176e2df6 WatchSource:0}: Error finding container 6abb09fe3c2709b039d7489e5a3faf96702eadbf36c98f460a35fc58176e2df6: Status 404 returned error can't find the container with id 6abb09fe3c2709b039d7489e5a3faf96702eadbf36c98f460a35fc58176e2df6
Jun 10 10:20:55.620552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:55.620518    2552 generic.go:356] "Generic (PLEG): container finished" podID="b81f4e83-c35a-4055-aa9c-ab225281e2e5" containerID="cc208ca273484411b49f3f87072b962d5b314e4a2e47fd29abb80c6dbcc35cfd" exitCode=0
Jun 10 10:20:55.620986 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:55.620603    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerDied","Data":"cc208ca273484411b49f3f87072b962d5b314e4a2e47fd29abb80c6dbcc35cfd"}
Jun 10 10:20:55.620986 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:55.620672    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"6abb09fe3c2709b039d7489e5a3faf96702eadbf36c98f460a35fc58176e2df6"}
Jun 10 10:20:56.580649 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.580609    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b07f540-a7bf-484a-a265-3abc7f286d93" path="/var/lib/kubelet/pods/4b07f540-a7bf-484a-a265-3abc7f286d93/volumes"
Jun 10 10:20:56.628351 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.628317    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"76da9632137b657d1e6565e9f85251b4c3c7c95ac572e20d7707dd372019b0b6"}
Jun 10 10:20:56.628738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.628376    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"a38844d77528f64a9ff2d6af97534b45548254005fddeba726486ae917ad484c"}
Jun 10 10:20:56.628738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.628408    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"dde6df3c5509b7aea5bb7ea60687c377c58e57bb7282a423b61d9349437d17f6"}
Jun 10 10:20:56.628738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.628434    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"78d6ad011fc339f2539568ab4ddeef53e71d110bd23f004b85502362a93c6e82"}
Jun 10 10:20:56.628738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.628457    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"510635ef130c67e8576f28177ae4394b25307a55576f5b27e8054881f583eb4d"}
Jun 10 10:20:56.628738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.628479    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b81f4e83-c35a-4055-aa9c-ab225281e2e5","Type":"ContainerStarted","Data":"f0e70fe2bb00c97da72f496b6671322f6c4ef25ebb3f5f78b4bac7d52e884e16"}
Jun 10 10:20:56.662726 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:56.662658    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.646729795 podStartE2EDuration="2.662634333s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.904538ms" isStatefulPod=false podCreationTimestamp="2026-06-10 10:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:20:56.662010981 +0000 UTC m=+144.518947414" watchObservedRunningTime="2026-06-10 10:20:56.662634333 +0000 UTC m=+144.519570766"
Jun 10 10:20:57.435740 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.435702    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:20:57.436373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.436316    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="prometheus" containerID="cri-o://dec24a621f4e1e3132b4dec9cf1955729573c50cc55b07b89cfd92655fca7ddb" gracePeriod=600
Jun 10 10:20:57.436890 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.436863    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cbc964f73a3585e74605a297c8269cf0bffbb1bf00ec4f5a72a840cfc39c63a3" gracePeriod=600
Jun 10 10:20:57.437060 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.437039    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-web" containerID="cri-o://1456ae4aec123201465121e3be437791a5adfbc953d85159753cec917992d113" gracePeriod=600
Jun 10 10:20:57.437184 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.437162    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="thanos-sidecar" containerID="cri-o://249623e1d511ccaaaf3b9b7bd731615723d5fa0e42baa430cd543a69577eed77" gracePeriod=600
Jun 10 10:20:57.437264 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.437019    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy" containerID="cri-o://9530c3eb2b967f83d1f9b2365bdeaab30de88becc8c45bd86ef73775587a8c63" gracePeriod=600
Jun 10 10:20:57.437332 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.437313    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="config-reloader" containerID="cri-o://f23197bdf91a6c1c931d154fb1b3929b22a9af226911fcd70bd6a5755776be3c" gracePeriod=600
Jun 10 10:20:57.636373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636338    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="cbc964f73a3585e74605a297c8269cf0bffbb1bf00ec4f5a72a840cfc39c63a3" exitCode=0
Jun 10 10:20:57.636373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636363    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="9530c3eb2b967f83d1f9b2365bdeaab30de88becc8c45bd86ef73775587a8c63" exitCode=0
Jun 10 10:20:57.636373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636371    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="249623e1d511ccaaaf3b9b7bd731615723d5fa0e42baa430cd543a69577eed77" exitCode=0
Jun 10 10:20:57.636373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636377    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="f23197bdf91a6c1c931d154fb1b3929b22a9af226911fcd70bd6a5755776be3c" exitCode=0
Jun 10 10:20:57.636373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636383    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="dec24a621f4e1e3132b4dec9cf1955729573c50cc55b07b89cfd92655fca7ddb" exitCode=0
Jun 10 10:20:57.636831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636408    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"cbc964f73a3585e74605a297c8269cf0bffbb1bf00ec4f5a72a840cfc39c63a3"}
Jun 10 10:20:57.636831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636475    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"9530c3eb2b967f83d1f9b2365bdeaab30de88becc8c45bd86ef73775587a8c63"}
Jun 10 10:20:57.636831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636502    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"249623e1d511ccaaaf3b9b7bd731615723d5fa0e42baa430cd543a69577eed77"}
Jun 10 10:20:57.636831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636527    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"f23197bdf91a6c1c931d154fb1b3929b22a9af226911fcd70bd6a5755776be3c"}
Jun 10 10:20:57.636831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:57.636554    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"dec24a621f4e1e3132b4dec9cf1955729573c50cc55b07b89cfd92655fca7ddb"}
Jun 10 10:20:58.644236 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.644195    2552 generic.go:356] "Generic (PLEG): container finished" podID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerID="1456ae4aec123201465121e3be437791a5adfbc953d85159753cec917992d113" exitCode=0
Jun 10 10:20:58.644611 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.644260    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"1456ae4aec123201465121e3be437791a5adfbc953d85159753cec917992d113"}
Jun 10 10:20:58.685927 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.685889    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:58.836942 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.836816    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-tls\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.836942 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.836854    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-kubelet-serving-ca-bundle\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.836942 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.836883    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-0\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.836942 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.836925    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-config-out\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837281 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.836957    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-1\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837281 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.836980    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-config\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837281 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837020    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-serving-certs-ca-bundle\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837281 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837044    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-db\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837281 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837071    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-tls-assets\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837519 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837349    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.837519 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837452    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.837622 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837549    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-2\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837622 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837590    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-thanos-prometheus-http-client-file\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837726 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837625    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837726 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837675    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-kube-rbac-proxy\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837731    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-metrics-client-ca\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837760    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-metrics-client-certs\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837786    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-grpc-tls\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.837832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837821    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-trusted-ca-bundle\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.838055 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837829    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.838055 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837855    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76mkb\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-kube-api-access-76mkb\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.838055 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837896    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.838055 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.837963    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-web-config\") pod \"6071abee-fbe8-4b42-bb0a-7d4412873980\" (UID: \"6071abee-fbe8-4b42-bb0a-7d4412873980\") "
Jun 10 10:20:58.838520 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.838263    2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.838520 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.838292    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.838520 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.838309    2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.838867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.838625    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.838867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.838651    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:20:58.839043 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.839013    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.839211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.839188    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.839684 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.839657    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:20:58.839832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.839808    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-config-out" (OuterVolumeSpecName: "config-out") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:20:58.840453 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.840414    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:20:58.840797 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.840763    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.841799 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.841750    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.842075 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.841881    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.842210 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.842166    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.842348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.842321    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-config" (OuterVolumeSpecName: "config") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.842509 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.842482    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.842589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.842552    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-kube-api-access-76mkb" (OuterVolumeSpecName: "kube-api-access-76mkb") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "kube-api-access-76mkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:20:58.842757 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.842736    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.843380 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.843361    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.852961 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.852844    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-web-config" (OuterVolumeSpecName: "web-config") pod "6071abee-fbe8-4b42-bb0a-7d4412873980" (UID: "6071abee-fbe8-4b42-bb0a-7d4412873980"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:20:58.939104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939063    2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-kube-rbac-proxy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939096    2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-configmap-metrics-client-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939111    2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-metrics-client-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939125    2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-grpc-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939137    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939150    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76mkb\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-kube-api-access-76mkb\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939162    2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939174    2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-web-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939186    2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939197    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939209    2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-config-out\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939219    2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-config\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939231    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-db\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939243    2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6071abee-fbe8-4b42-bb0a-7d4412873980-tls-assets\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939254    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6071abee-fbe8-4b42-bb0a-7d4412873980-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939266    2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:58.939404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:58.939278    2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6071abee-fbe8-4b42-bb0a-7d4412873980-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:20:59.651741 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.651716    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.652145 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.651711    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6071abee-fbe8-4b42-bb0a-7d4412873980","Type":"ContainerDied","Data":"3c462ac430a2dc4e0bbdd39a848cabe725c60216a85083802301a12cd3397f9e"}
Jun 10 10:20:59.652145 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.651859    2552 scope.go:117] "RemoveContainer" containerID="cbc964f73a3585e74605a297c8269cf0bffbb1bf00ec4f5a72a840cfc39c63a3"
Jun 10 10:20:59.660100 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.660076    2552 scope.go:117] "RemoveContainer" containerID="9530c3eb2b967f83d1f9b2365bdeaab30de88becc8c45bd86ef73775587a8c63"
Jun 10 10:20:59.667455 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.667429    2552 scope.go:117] "RemoveContainer" containerID="1456ae4aec123201465121e3be437791a5adfbc953d85159753cec917992d113"
Jun 10 10:20:59.674298 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.674278    2552 scope.go:117] "RemoveContainer" containerID="249623e1d511ccaaaf3b9b7bd731615723d5fa0e42baa430cd543a69577eed77"
Jun 10 10:20:59.681160 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.681136    2552 scope.go:117] "RemoveContainer" containerID="f23197bdf91a6c1c931d154fb1b3929b22a9af226911fcd70bd6a5755776be3c"
Jun 10 10:20:59.682620 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.682597    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:20:59.688332 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.688315    2552 scope.go:117] "RemoveContainer" containerID="dec24a621f4e1e3132b4dec9cf1955729573c50cc55b07b89cfd92655fca7ddb"
Jun 10 10:20:59.695895 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.695875    2552 scope.go:117] "RemoveContainer" containerID="df5e93944ddb5d787bd8abc7440b4bacec5770456a9d6f6089fc7db496a217e3"
Jun 10 10:20:59.698114 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.698094    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:20:59.741251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741168    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:20:59.741482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741470    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="config-reloader"
Jun 10 10:20:59.741524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741484    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="config-reloader"
Jun 10 10:20:59.741524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741494    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-thanos"
Jun 10 10:20:59.741524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741499    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-thanos"
Jun 10 10:20:59.741524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741508    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="thanos-sidecar"
Jun 10 10:20:59.741524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741513    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="thanos-sidecar"
Jun 10 10:20:59.741524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741523    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="prometheus"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741528    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="prometheus"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741536    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741541    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741558    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="init-config-reloader"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741563    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="init-config-reloader"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741569    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-web"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741574    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-web"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741620    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="config-reloader"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741627    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-web"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741637    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="prometheus"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741642    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy-thanos"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741648    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="kube-rbac-proxy"
Jun 10 10:20:59.741711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.741654    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" containerName="thanos-sidecar"
Jun 10 10:20:59.745148 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.745130    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.750653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.750609    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 10 10:20:59.750883 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.750861    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 10 10:20:59.751016 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.750967    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 10 10:20:59.751101 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751084    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 10 10:20:59.751263 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751249    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 10 10:20:59.751345 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751281    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 10 10:20:59.751954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751640    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 10 10:20:59.751954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751659    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 10 10:20:59.751954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751689    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 10 10:20:59.751954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751648    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 10 10:20:59.751954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751818    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 10 10:20:59.751954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.751640    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 10 10:20:59.752665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.752262    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pe7lepc92ola\""
Jun 10 10:20:59.752665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.752624    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9jtj2\""
Jun 10 10:20:59.755324 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.755303    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 10 10:20:59.762856 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.762835    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 10 10:20:59.771555 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.771527    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:20:59.846426 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846385    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846426 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846434    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-web-config\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846480    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846503    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846524    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846640    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-config\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846670    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846695    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846711    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj7gw\" (UniqueName: \"kubernetes.io/projected/89173a1b-a940-437f-9e98-74b7b0a9a332-kube-api-access-nj7gw\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846766    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846790    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89173a1b-a940-437f-9e98-74b7b0a9a332-config-out\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846856    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.846888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.847196 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846932    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.847196 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846966    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.847196 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.846996    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.847196 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.847015    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89173a1b-a940-437f-9e98-74b7b0a9a332-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948396 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948358    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948396 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948399    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948419    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj7gw\" (UniqueName: \"kubernetes.io/projected/89173a1b-a940-437f-9e98-74b7b0a9a332-kube-api-access-nj7gw\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948440    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948471    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948505    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89173a1b-a940-437f-9e98-74b7b0a9a332-config-out\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948533    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948568    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948596    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948624    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948670    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948696    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89173a1b-a940-437f-9e98-74b7b0a9a332-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948727    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948764    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-web-config\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948785    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948810    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948838    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948885    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.948965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948961    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-config\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.949473 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.948990    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.949473 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.949390    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.949582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.949532    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.950643 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.950015    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.950961    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.951023    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.951287    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.951347    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.951726    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.951816    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.952599 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.952257    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.953487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.953275    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.953487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.953375    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-web-config\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.953487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.953442    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.953873 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.953848    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.954283 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.954257    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89173a1b-a940-437f-9e98-74b7b0a9a332-config-out\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.954616 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.954596    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89173a1b-a940-437f-9e98-74b7b0a9a332-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.954698 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.954643    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.954841 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.954824    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89173a1b-a940-437f-9e98-74b7b0a9a332-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.954954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.954932    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/89173a1b-a940-437f-9e98-74b7b0a9a332-config\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:20:59.961062 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:20:59.961041    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj7gw\" (UniqueName: \"kubernetes.io/projected/89173a1b-a940-437f-9e98-74b7b0a9a332-kube-api-access-nj7gw\") pod \"prometheus-k8s-0\" (UID: \"89173a1b-a940-437f-9e98-74b7b0a9a332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:21:00.055004 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:00.054887    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:21:00.203121 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:00.203095    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 10:21:00.205270 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:21:00.205244    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89173a1b_a940_437f_9e98_74b7b0a9a332.slice/crio-3c4ede39bcbd956f9a148130a58bb244118c7da618240d2d923a85016165e975 WatchSource:0}: Error finding container 3c4ede39bcbd956f9a148130a58bb244118c7da618240d2d923a85016165e975: Status 404 returned error can't find the container with id 3c4ede39bcbd956f9a148130a58bb244118c7da618240d2d923a85016165e975
Jun 10 10:21:00.579246 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:00.579209    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6071abee-fbe8-4b42-bb0a-7d4412873980" path="/var/lib/kubelet/pods/6071abee-fbe8-4b42-bb0a-7d4412873980/volumes"
Jun 10 10:21:00.657676 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:00.657639    2552 generic.go:356] "Generic (PLEG): container finished" podID="89173a1b-a940-437f-9e98-74b7b0a9a332" containerID="d8d6eea87c52619a960de8782827502c7d2795a4726a4734da9fa322b61f9068" exitCode=0
Jun 10 10:21:00.658157 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:00.657728    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerDied","Data":"d8d6eea87c52619a960de8782827502c7d2795a4726a4734da9fa322b61f9068"}
Jun 10 10:21:00.658157 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:00.657820    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"3c4ede39bcbd956f9a148130a58bb244118c7da618240d2d923a85016165e975"}
Jun 10 10:21:01.666327 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.666293    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"4c43158bf2f25765cca9cc7f7461f75337f8e71a72cec0fbc3e8c50afcc2b159"}
Jun 10 10:21:01.666692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.666357    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"f1b2dc56f48a8e1a2ec382ca285480f3c1320513cf3fb235f49463cf711d6480"}
Jun 10 10:21:01.666692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.666385    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"aa252a6889e62f67ef755dc0ff102e7a3cce1d0a3c48bd2a149a543c4a793904"}
Jun 10 10:21:01.666692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.666409    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"84c373721fa77819c135fe59ab7df2fa43f79d566a2772a2b5046de9a1e2d378"}
Jun 10 10:21:01.666692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.666436    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"b6f5ab387cfd3496fbfa32b3b3a0431ada81b867ef6196c50a2cc56fcdd99211"}
Jun 10 10:21:01.666692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.666461    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89173a1b-a940-437f-9e98-74b7b0a9a332","Type":"ContainerStarted","Data":"586147910c66239d9bbfbeab49df09056eae6cd49e520dc96b894b24cf8890d0"}
Jun 10 10:21:01.700672 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:01.700330    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.679741867 podStartE2EDuration="2.700307996s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.566129ms" isStatefulPod=false podCreationTimestamp="2026-06-10 10:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:21:01.696756363 +0000 UTC m=+149.553692836" watchObservedRunningTime="2026-06-10 10:21:01.700307996 +0000 UTC m=+149.557244430"
Jun 10 10:21:05.055361 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:21:05.055322    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:22:00.055976 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:22:00.055936    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:22:00.071553 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:22:00.071528    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:22:00.930073 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:22:00.930048    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 10:23:32.531972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:32.531948    2552 kubelet.go:1648] "Image garbage collection succeeded"
Jun 10 10:23:58.253840 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.253806    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"]
Jun 10 10:23:58.257413 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.257396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.261354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.261331    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 10 10:23:58.261963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.261946    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 10 10:23:58.262465 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.262446    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 10 10:23:58.262560 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.262519    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 10 10:23:58.262627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.262580    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 10 10:23:58.262682 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.262630    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 10 10:23:58.262948 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.262929    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wz5nr\""
Jun 10 10:23:58.263035 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.263004    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 10 10:23:58.280270 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.280248    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"]
Jun 10 10:23:58.414888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.414855    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-online-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.415077 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.414896    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.415077 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.414959    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.415077 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.414984    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wp28\" (UniqueName: \"kubernetes.io/projected/5661f3c2-9b6f-4893-af99-243add48bcc3-kube-api-access-4wp28\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.415077 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.415008    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5661f3c2-9b6f-4893-af99-243add48bcc3-feast-data\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.415254 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.415097    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-registry-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516316 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516231    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-registry-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516316 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516281    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-online-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516318    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516363    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516398    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp28\" (UniqueName: \"kubernetes.io/projected/5661f3c2-9b6f-4893-af99-243add48bcc3-kube-api-access-4wp28\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516435    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5661f3c2-9b6f-4893-af99-243add48bcc3-feast-data\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.516533 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:23:58.516480    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:23:58.516818 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:23:58.516562    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls podName:5661f3c2-9b6f-4893-af99-243add48bcc3 nodeName:}" failed. No retries permitted until 2026-06-10 10:23:59.016544596 +0000 UTC m=+326.873481021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls") pod "feast-simple-feast-setup-84d578cf8-5k8fr" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:23:58.516883 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.516812    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5661f3c2-9b6f-4893-af99-243add48bcc3-feast-data\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.518731 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.518710    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-online-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.519093 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.519078    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.519273 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.519252    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-registry-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:58.530637 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:58.530614    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wp28\" (UniqueName: \"kubernetes.io/projected/5661f3c2-9b6f-4893-af99-243add48bcc3-kube-api-access-4wp28\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:59.020856 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:59.020817    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:59.023206 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:59.023185    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-5k8fr\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:59.172674 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:59.172639    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:23:59.315672 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:59.315649    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"]
Jun 10 10:23:59.316141 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:23:59.316118    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5661f3c2_9b6f_4893_af99_243add48bcc3.slice/crio-464267ae1a8f182002582f86db453fbfe72b83e5ce78efd5bb3ce4313c7d4dde WatchSource:0}: Error finding container 464267ae1a8f182002582f86db453fbfe72b83e5ce78efd5bb3ce4313c7d4dde: Status 404 returned error can't find the container with id 464267ae1a8f182002582f86db453fbfe72b83e5ce78efd5bb3ce4313c7d4dde
Jun 10 10:23:59.317949 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:59.317936    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 10:23:59.389735 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:23:59.389702    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"464267ae1a8f182002582f86db453fbfe72b83e5ce78efd5bb3ce4313c7d4dde"}
Jun 10 10:24:31.531984 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:31.531947    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"a2cff36b12bc452205be2803b523d9d450e53cecd38a770fb3fd8bd4cecbe868"}
Jun 10 10:24:36.553842 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:36.553802    2552 generic.go:356] "Generic (PLEG): container finished" podID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerID="a2cff36b12bc452205be2803b523d9d450e53cecd38a770fb3fd8bd4cecbe868" exitCode=0
Jun 10 10:24:36.554321 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:36.553878    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"a2cff36b12bc452205be2803b523d9d450e53cecd38a770fb3fd8bd4cecbe868"}
Jun 10 10:24:37.560213 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:37.560180    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"9ca2523cb98013513ae186375851363c07399891497d99ae6ef1a0059896b873"}
Jun 10 10:24:42.582772 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:42.582734    2552 generic.go:356] "Generic (PLEG): container finished" podID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerID="9ca2523cb98013513ae186375851363c07399891497d99ae6ef1a0059896b873" exitCode=0
Jun 10 10:24:42.583166 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:42.582794    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"9ca2523cb98013513ae186375851363c07399891497d99ae6ef1a0059896b873"}
Jun 10 10:24:42.591831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:42.591812    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 10 10:24:43.594130 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:43.594082    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"410a13127e9e6dc7bbecef97fe0cf16a5cdbed9004cd2a23526f70a0b4bd34ce"}
Jun 10 10:24:43.594590 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:43.594151    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"42fc9dda2954bd73ee45baedf63f47cb74a6fae0894c07a91c2e917a0d933f48"}
Jun 10 10:24:43.594590 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:43.594176    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"5beefd89c27e14594acc6291ae4d8dfce4977c04d2668c9871de9ad2555ad7c5"}
Jun 10 10:24:43.594590 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:43.594195    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerStarted","Data":"2800a614df4ae51762aed77405f61e56b47aa3e3b6e7197d61fc8e9141317175"}
Jun 10 10:24:43.646733 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:43.646666    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podStartSLOduration=13.877377397 podStartE2EDuration="45.646644649s" totalImagesPullingTime="31.769267252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:24:43.644721972 +0000 UTC m=+371.501658408" watchObservedRunningTime="2026-06-10 10:24:43.646644649 +0000 UTC m=+371.503581082"
Jun 10 10:24:44.174036 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.173993    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:44.174351 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.174328    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:44.174351 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.174360    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:44.174551 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.174379    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:44.176099 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.176055    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
Jun 10 10:24:44.176215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.176090    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 10 10:24:44.176215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.176107    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 10 10:24:44.176215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:44.176174    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
Jun 10 10:24:47.173823 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:47.173765    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
Jun 10 10:24:47.173823 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:47.173807    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 10 10:24:47.174403 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:47.173777    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
Jun 10 10:24:47.174403 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:47.174021    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 10 10:24:49.173341 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:49.173299    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:49.173724 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:49.173363    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:49.173724 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:49.173377    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:49.173724 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:49.173388    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.174041 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.174006    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.174513 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.174211    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.174513 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.174338    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.174993 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.174973    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.175112 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.175100    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.175225 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.175198    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.179072 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.179049    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:24:50.638567 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:24:50.638533    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:25:53.652733 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:53.652651    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"]
Jun 10 10:25:53.653297 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:53.652870    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="registry" containerID="cri-o://2800a614df4ae51762aed77405f61e56b47aa3e3b6e7197d61fc8e9141317175" gracePeriod=30
Jun 10 10:25:53.653297 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:53.652961    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="offline" containerID="cri-o://42fc9dda2954bd73ee45baedf63f47cb74a6fae0894c07a91c2e917a0d933f48" gracePeriod=30
Jun 10 10:25:53.653297 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:53.652970    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online" containerID="cri-o://5beefd89c27e14594acc6291ae4d8dfce4977c04d2668c9871de9ad2555ad7c5" gracePeriod=30
Jun 10 10:25:53.653297 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:53.652965    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui" containerID="cri-o://410a13127e9e6dc7bbecef97fe0cf16a5cdbed9004cd2a23526f70a0b4bd34ce" gracePeriod=30
Jun 10 10:25:54.084709 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.084626    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"]
Jun 10 10:25:54.088407 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.088385    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.091299 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.091276    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-st7vd\""
Jun 10 10:25:54.107054 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.107017    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"]
Jun 10 10:25:54.147310 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.147276    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.147471 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.147316    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.147471 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.147410    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-registry-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.147560 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.147505    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-online-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.147604 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.147562    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx4t7\" (UniqueName: \"kubernetes.io/projected/924946ee-dc75-4c7f-8e6e-86203aa3e452-kube-api-access-lx4t7\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.147678 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.147640    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/924946ee-dc75-4c7f-8e6e-86203aa3e452-feast-data\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.248569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.248526    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.248569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.248572    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.248827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.248600    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-registry-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.248827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.248632    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-online-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.248827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.248665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx4t7\" (UniqueName: \"kubernetes.io/projected/924946ee-dc75-4c7f-8e6e-86203aa3e452-kube-api-access-lx4t7\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.248827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.248703    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/924946ee-dc75-4c7f-8e6e-86203aa3e452-feast-data\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.249079 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:25:54.248865    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 10 10:25:54.249079 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:25:54.248984    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls podName:924946ee-dc75-4c7f-8e6e-86203aa3e452 nodeName:}" failed. No retries permitted until 2026-06-10 10:25:54.748960077 +0000 UTC m=+442.605896500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls") pod "feast-simple-feast-setup-84d578cf8-jdxsf" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 10 10:25:54.249203 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.249150    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/924946ee-dc75-4c7f-8e6e-86203aa3e452-feast-data\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.251170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.251145    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-online-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.251332 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.251312    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-ui-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.251374 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.251312    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-registry-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.259089 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.259065    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx4t7\" (UniqueName: \"kubernetes.io/projected/924946ee-dc75-4c7f-8e6e-86203aa3e452-kube-api-access-lx4t7\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.755489 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.755438    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.757809 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.757776    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls\") pod \"feast-simple-feast-setup-84d578cf8-jdxsf\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") " pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:54.898224 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.898192    2552 generic.go:356] "Generic (PLEG): container finished" podID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerID="410a13127e9e6dc7bbecef97fe0cf16a5cdbed9004cd2a23526f70a0b4bd34ce" exitCode=0
Jun 10 10:25:54.898224 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.898217    2552 generic.go:356] "Generic (PLEG): container finished" podID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerID="5beefd89c27e14594acc6291ae4d8dfce4977c04d2668c9871de9ad2555ad7c5" exitCode=0
Jun 10 10:25:54.898421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.898256    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"410a13127e9e6dc7bbecef97fe0cf16a5cdbed9004cd2a23526f70a0b4bd34ce"}
Jun 10 10:25:54.898421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.898295    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"5beefd89c27e14594acc6291ae4d8dfce4977c04d2668c9871de9ad2555ad7c5"}
Jun 10 10:25:54.998528 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:54.998495    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:25:55.141010 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:55.140984    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"]
Jun 10 10:25:55.141871 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:25:55.141844    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod924946ee_dc75_4c7f_8e6e_86203aa3e452.slice/crio-b0466e5492ac128f3ef52836f6fe9139f3b80623a2a61c21aa71e22bf6bdff4a WatchSource:0}: Error finding container b0466e5492ac128f3ef52836f6fe9139f3b80623a2a61c21aa71e22bf6bdff4a: Status 404 returned error can't find the container with id b0466e5492ac128f3ef52836f6fe9139f3b80623a2a61c21aa71e22bf6bdff4a
Jun 10 10:25:55.904503 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:55.904468    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"fe1c3f14712020ddccc754efd9806b9c1d0584b935ffa2d3ca086c61fddc41f8"}
Jun 10 10:25:55.904965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:55.904517    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"b0466e5492ac128f3ef52836f6fe9139f3b80623a2a61c21aa71e22bf6bdff4a"}
Jun 10 10:25:59.932662 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:59.932631    2552 generic.go:356] "Generic (PLEG): container finished" podID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerID="fe1c3f14712020ddccc754efd9806b9c1d0584b935ffa2d3ca086c61fddc41f8" exitCode=0
Jun 10 10:25:59.932662 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:25:59.932666    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"fe1c3f14712020ddccc754efd9806b9c1d0584b935ffa2d3ca086c61fddc41f8"}
Jun 10 10:26:00.176403 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:00.176102    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 10 10:26:00.636450 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:00.636408    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 10 10:26:00.939711 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:00.939625    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"c491d06ef1e33b0eab9bc592b88cc0114a5068756087bdbec3ec5fa40afbbe3d"}
Jun 10 10:26:05.961562 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:05.961528    2552 generic.go:356] "Generic (PLEG): container finished" podID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerID="c491d06ef1e33b0eab9bc592b88cc0114a5068756087bdbec3ec5fa40afbbe3d" exitCode=0
Jun 10 10:26:05.962030 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:05.961566    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"c491d06ef1e33b0eab9bc592b88cc0114a5068756087bdbec3ec5fa40afbbe3d"}
Jun 10 10:26:06.972502 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.972455    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"3fa64a9dd0aeaed75bdfbfddb654b349d4b428a245e0cf009f61759045855715"}
Jun 10 10:26:06.973024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.972523    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"9f451630a1f2664d37673e31d691445444a818ae9178465c9edac7adf83d3ea1"}
Jun 10 10:26:06.973024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.972548    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"6f7f7855bd0bd32c7bf1ccb5142f6b5292177f933d45a0d06d3714a56b6f6ecd"}
Jun 10 10:26:06.973024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.972566    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerStarted","Data":"8aa692f5dd8118f29e068bfe2719621fbd1db5cd8b91185502aa23859d73a7e7"}
Jun 10 10:26:06.999292 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.999249    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:06.999564 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.999545    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:06.999690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.999679    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:06.999855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:06.999841    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:07.001647 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:07.001611    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused"
Jun 10 10:26:07.002215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:07.001836    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 10 10:26:07.002304 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:07.001874    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
Jun 10 10:26:07.002304 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:07.001954    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 10 10:26:07.002725 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:07.002674    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podStartSLOduration=13.002656967 podStartE2EDuration="13.002656967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:26:07.000485148 +0000 UTC m=+454.857421601" watchObservedRunningTime="2026-06-10 10:26:07.002656967 +0000 UTC m=+454.859593400"
Jun 10 10:26:09.998790 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:09.998740    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 10 10:26:09.999268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:09.998747    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused"
Jun 10 10:26:09.999268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:09.998753    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
Jun 10 10:26:09.999268 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:09.998901    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 10 10:26:10.175706 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:10.175650    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 10 10:26:10.636573 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:10.636523    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 10 10:26:13.000184 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.000150    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.000572 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.000282    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.000572 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.000509    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.000970 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.000941    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.001122 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.000991    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.001122 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.001011    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.001301 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.001285    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.001349 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.001336    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.001401 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.001392    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.005231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.005211    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.006954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.006936    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:13.009431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:13.009410    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:26:20.175139 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:20.175092    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jun 10 10:26:20.175604 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:20.175235    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:26:20.636469 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:20.636432    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jun 10 10:26:20.636621 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:20.636553    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:26:24.061088 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.061012    2552 generic.go:356] "Generic (PLEG): container finished" podID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerID="42fc9dda2954bd73ee45baedf63f47cb74a6fae0894c07a91c2e917a0d933f48" exitCode=137
Jun 10 10:26:24.061088 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.061036    2552 generic.go:356] "Generic (PLEG): container finished" podID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerID="2800a614df4ae51762aed77405f61e56b47aa3e3b6e7197d61fc8e9141317175" exitCode=137
Jun 10 10:26:24.061457 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.061079    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"42fc9dda2954bd73ee45baedf63f47cb74a6fae0894c07a91c2e917a0d933f48"}
Jun 10 10:26:24.061457 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.061120    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"2800a614df4ae51762aed77405f61e56b47aa3e3b6e7197d61fc8e9141317175"}
Jun 10 10:26:24.296113 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.296092    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:26:24.322189 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.322129    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-registry-tls\") pod \"5661f3c2-9b6f-4893-af99-243add48bcc3\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") "
Jun 10 10:26:24.322189 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.322164    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls\") pod \"5661f3c2-9b6f-4893-af99-243add48bcc3\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") "
Jun 10 10:26:24.324679 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.324651    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5661f3c2-9b6f-4893-af99-243add48bcc3" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:26:24.325019 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.324979    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5661f3c2-9b6f-4893-af99-243add48bcc3" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:26:24.423390 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423356    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-online-tls\") pod \"5661f3c2-9b6f-4893-af99-243add48bcc3\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") "
Jun 10 10:26:24.423552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423442    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5661f3c2-9b6f-4893-af99-243add48bcc3-feast-data\") pod \"5661f3c2-9b6f-4893-af99-243add48bcc3\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") "
Jun 10 10:26:24.423552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423489    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wp28\" (UniqueName: \"kubernetes.io/projected/5661f3c2-9b6f-4893-af99-243add48bcc3-kube-api-access-4wp28\") pod \"5661f3c2-9b6f-4893-af99-243add48bcc3\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") "
Jun 10 10:26:24.423552 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423540    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-offline-tls\") pod \"5661f3c2-9b6f-4893-af99-243add48bcc3\" (UID: \"5661f3c2-9b6f-4893-af99-243add48bcc3\") "
Jun 10 10:26:24.423784 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423757    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:26:24.423784 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423788    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:26:24.423976 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.423881    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5661f3c2-9b6f-4893-af99-243add48bcc3-feast-data" (OuterVolumeSpecName: "feast-data") pod "5661f3c2-9b6f-4893-af99-243add48bcc3" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:26:24.425393 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.425375    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-online-tls" (OuterVolumeSpecName: "online-tls") pod "5661f3c2-9b6f-4893-af99-243add48bcc3" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:26:24.425491 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.425474    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5661f3c2-9b6f-4893-af99-243add48bcc3-kube-api-access-4wp28" (OuterVolumeSpecName: "kube-api-access-4wp28") pod "5661f3c2-9b6f-4893-af99-243add48bcc3" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3"). InnerVolumeSpecName "kube-api-access-4wp28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:26:24.425543 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.425473    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5661f3c2-9b6f-4893-af99-243add48bcc3" (UID: "5661f3c2-9b6f-4893-af99-243add48bcc3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:26:24.524928 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.524865    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5661f3c2-9b6f-4893-af99-243add48bcc3-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:26:24.524928 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.524898    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wp28\" (UniqueName: \"kubernetes.io/projected/5661f3c2-9b6f-4893-af99-243add48bcc3-kube-api-access-4wp28\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:26:24.524928 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.524929    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:26:24.524928 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:24.524939    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5661f3c2-9b6f-4893-af99-243add48bcc3-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:26:25.071670 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.071640    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"
Jun 10 10:26:25.072130 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.071666    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr" event={"ID":"5661f3c2-9b6f-4893-af99-243add48bcc3","Type":"ContainerDied","Data":"464267ae1a8f182002582f86db453fbfe72b83e5ce78efd5bb3ce4313c7d4dde"}
Jun 10 10:26:25.072130 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.071726    2552 scope.go:117] "RemoveContainer" containerID="410a13127e9e6dc7bbecef97fe0cf16a5cdbed9004cd2a23526f70a0b4bd34ce"
Jun 10 10:26:25.080432 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.080405    2552 scope.go:117] "RemoveContainer" containerID="42fc9dda2954bd73ee45baedf63f47cb74a6fae0894c07a91c2e917a0d933f48"
Jun 10 10:26:25.087805 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.087788    2552 scope.go:117] "RemoveContainer" containerID="5beefd89c27e14594acc6291ae4d8dfce4977c04d2668c9871de9ad2555ad7c5"
Jun 10 10:26:25.095792 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.095756    2552 scope.go:117] "RemoveContainer" containerID="2800a614df4ae51762aed77405f61e56b47aa3e3b6e7197d61fc8e9141317175"
Jun 10 10:26:25.097255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.097233    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"]
Jun 10 10:26:25.100369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.100348    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-5k8fr"]
Jun 10 10:26:25.104236 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.104220    2552 scope.go:117] "RemoveContainer" containerID="9ca2523cb98013513ae186375851363c07399891497d99ae6ef1a0059896b873"
Jun 10 10:26:25.111010 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:25.110988    2552 scope.go:117] "RemoveContainer" containerID="a2cff36b12bc452205be2803b523d9d450e53cecd38a770fb3fd8bd4cecbe868"
Jun 10 10:26:26.579952 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:26:26.579921    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" path="/var/lib/kubelet/pods/5661f3c2-9b6f-4893-af99-243add48bcc3/volumes"
Jun 10 10:27:16.048055 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048019    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"]
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048353    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="offline"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048364    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="offline"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048377    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="feast-init"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048382    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="feast-init"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048392    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="registry"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048398    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="registry"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048405    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="feast-apply"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048410    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="feast-apply"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048415    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048420    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048430    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048435    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048481    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="ui"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048490    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="registry"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048497    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="offline"
Jun 10 10:27:16.048527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.048503    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5661f3c2-9b6f-4893-af99-243add48bcc3" containerName="online"
Jun 10 10:27:16.052009 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.051991    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.057414 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.057386    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 10 10:27:16.057414 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.057401    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 10 10:27:16.060175 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.060089    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 10 10:27:16.060175 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.060142    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 10 10:27:16.060323 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.060184    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 10 10:27:16.060323 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.060206    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 10 10:27:16.060402 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.060387    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-whq7n\""
Jun 10 10:27:16.065715 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.065700    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 10 10:27:16.078465 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.078438    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-feast-data\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.078576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.078478    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.078576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.078539    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-online-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.078576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.078571    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqrs\" (UniqueName: \"kubernetes.io/projected/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-kube-api-access-hzqrs\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.078707 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.078658    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-offline-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.078707 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.078675    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-registry-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.099483 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.099461    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"]
Jun 10 10:27:16.179136 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179100    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-offline-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179136 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179133    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-registry-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179374 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179177    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-feast-data\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179374 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179345    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179479 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179392    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-online-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179479 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179420    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqrs\" (UniqueName: \"kubernetes.io/projected/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-kube-api-access-hzqrs\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179581 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:27:16.179476    2552 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 10 10:27:16.179581 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:27:16.179555    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls podName:0a09aa66-b47e-40f0-bcd2-0bbc05c905fc nodeName:}" failed. No retries permitted until 2026-06-10 10:27:16.679531896 +0000 UTC m=+524.536468320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls") pod "feast-simple-feast-remote-setup-5b766b898-svsgj" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 10 10:27:16.179581 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179561    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-feast-data\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.179955 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.179902    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-registry-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.181700 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.181681    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-offline-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.181846 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.181715    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-online-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.200289 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.200268    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqrs\" (UniqueName: \"kubernetes.io/projected/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-kube-api-access-hzqrs\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.684088 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.684052    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.686434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.686408    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls\") pod \"feast-simple-feast-remote-setup-5b766b898-svsgj\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:16.961690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:16.961596    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:17.132641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:17.132611    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"]
Jun 10 10:27:17.133869 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:27:17.133843    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a09aa66_b47e_40f0_bcd2_0bbc05c905fc.slice/crio-75daec20cb4ccec5fd1892617e468fe67a56e5b63e643b0566979da3488b00a0 WatchSource:0}: Error finding container 75daec20cb4ccec5fd1892617e468fe67a56e5b63e643b0566979da3488b00a0: Status 404 returned error can't find the container with id 75daec20cb4ccec5fd1892617e468fe67a56e5b63e643b0566979da3488b00a0
Jun 10 10:27:17.286507 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:17.286470    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerStarted","Data":"d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679"}
Jun 10 10:27:17.286691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:17.286521    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerStarted","Data":"75daec20cb4ccec5fd1892617e468fe67a56e5b63e643b0566979da3488b00a0"}
Jun 10 10:27:22.309821 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:22.309783    2552 generic.go:356] "Generic (PLEG): container finished" podID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerID="d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679" exitCode=0
Jun 10 10:27:22.310276 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:22.309854    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerDied","Data":"d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679"}
Jun 10 10:27:23.316217 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:23.316184    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerStarted","Data":"87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152"}
Jun 10 10:27:28.339202 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:28.339115    2552 generic.go:356] "Generic (PLEG): container finished" podID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerID="87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152" exitCode=0
Jun 10 10:27:28.339202 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:28.339185    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerDied","Data":"87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152"}
Jun 10 10:27:29.348628 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:29.348587    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerStarted","Data":"fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240"}
Jun 10 10:27:29.349136 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:29.348639    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerStarted","Data":"2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e"}
Jun 10 10:27:29.349136 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:29.348652    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerStarted","Data":"5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa"}
Jun 10 10:27:29.405093 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:29.405041    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podStartSLOduration=13.405026831 podStartE2EDuration="13.405026831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:27:29.402514835 +0000 UTC m=+537.259451267" watchObservedRunningTime="2026-06-10 10:27:29.405026831 +0000 UTC m=+537.261963263"
Jun 10 10:27:31.962211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:31.962129    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:31.962211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:31.962217    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:31.962746 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:31.962237    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:31.964219 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:31.964179    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
Jun 10 10:27:31.964219 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:31.964198    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 10 10:27:31.964403 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:31.964216    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 10 10:27:34.963250 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.963217    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:34.963707 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.963326    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:34.963800 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.963713    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:34.963800 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.963755    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:34.964033 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.964014    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:34.964105 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.964087    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:34.967448 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:34.967429    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:35.378935 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:35.378893    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:27:35.381810 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:27:35.381795    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:28:37.190329 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.190288    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"]
Jun 10 10:28:37.190931 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.190567    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online" containerID="cri-o://5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa" gracePeriod=30
Jun 10 10:28:37.190931 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.190663    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui" containerID="cri-o://fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240" gracePeriod=30
Jun 10 10:28:37.190931 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.190665    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="offline" containerID="cri-o://2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e" gracePeriod=30
Jun 10 10:28:37.236971 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.236933    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"]
Jun 10 10:28:37.237150 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.237130    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="registry" containerID="cri-o://8aa692f5dd8118f29e068bfe2719621fbd1db5cd8b91185502aa23859d73a7e7" gracePeriod=30
Jun 10 10:28:37.237215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.237181    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online" containerID="cri-o://6f7f7855bd0bd32c7bf1ccb5142f6b5292177f933d45a0d06d3714a56b6f6ecd" gracePeriod=30
Jun 10 10:28:37.237269 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.237195    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="offline" containerID="cri-o://9f451630a1f2664d37673e31d691445444a818ae9178465c9edac7adf83d3ea1" gracePeriod=30
Jun 10 10:28:37.237311 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:37.237179    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui" containerID="cri-o://3fa64a9dd0aeaed75bdfbfddb654b349d4b428a245e0cf009f61759045855715" gracePeriod=30
Jun 10 10:28:38.652424 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.652390    2552 generic.go:356] "Generic (PLEG): container finished" podID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerID="3fa64a9dd0aeaed75bdfbfddb654b349d4b428a245e0cf009f61759045855715" exitCode=0
Jun 10 10:28:38.652424 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.652414    2552 generic.go:356] "Generic (PLEG): container finished" podID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerID="6f7f7855bd0bd32c7bf1ccb5142f6b5292177f933d45a0d06d3714a56b6f6ecd" exitCode=0
Jun 10 10:28:38.652927 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.652464    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"3fa64a9dd0aeaed75bdfbfddb654b349d4b428a245e0cf009f61759045855715"}
Jun 10 10:28:38.652927 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.652513    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"6f7f7855bd0bd32c7bf1ccb5142f6b5292177f933d45a0d06d3714a56b6f6ecd"}
Jun 10 10:28:38.654955 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.654931    2552 generic.go:356] "Generic (PLEG): container finished" podID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerID="fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240" exitCode=0
Jun 10 10:28:38.654955 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.654954    2552 generic.go:356] "Generic (PLEG): container finished" podID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerID="5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa" exitCode=0
Jun 10 10:28:38.655105 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.654933    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerDied","Data":"fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240"}
Jun 10 10:28:38.655105 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:38.654987    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerDied","Data":"5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa"}
Jun 10 10:28:43.001466 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:43.001409    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 10 10:28:43.007217 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:43.007188    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 10 10:28:44.964702 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:44.964653    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 10 10:28:45.379041 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:45.379007    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 10 10:28:53.001244 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:53.001128    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 10 10:28:53.007694 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:53.007669    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 10 10:28:54.964438 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:54.964396    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 10 10:28:55.379496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:28:55.379454    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 10 10:29:03.001202 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:03.001156    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jun 10 10:29:03.003831 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:03.001317    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:29:03.007495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:03.007473    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jun 10 10:29:03.007583 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:03.007555    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:29:04.963990 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:04.963947    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Jun 10 10:29:04.964414 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:04.964067    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:29:05.379333 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:05.379290    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Jun 10 10:29:05.379487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:05.379447    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:29:07.370190 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.370165    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:29:07.463755 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.463613    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzqrs\" (UniqueName: \"kubernetes.io/projected/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-kube-api-access-hzqrs\") pod \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") "
Jun 10 10:29:07.463902 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.463759    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls\") pod \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") "
Jun 10 10:29:07.463902 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.463810    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-feast-data\") pod \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") "
Jun 10 10:29:07.463902 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.463832    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-online-tls\") pod \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") "
Jun 10 10:29:07.463902 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.463857    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-registry-tls\") pod \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") "
Jun 10 10:29:07.463902 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.463879    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-offline-tls\") pod \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\" (UID: \"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc\") "
Jun 10 10:29:07.464342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.464310    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:29:07.464477 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.464415    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-feast-data" (OuterVolumeSpecName: "feast-data") pod "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:29:07.466005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.465967    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:07.466005 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.465988    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-online-tls" (OuterVolumeSpecName: "online-tls") pod "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:07.466147 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.466007    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-kube-api-access-hzqrs" (OuterVolumeSpecName: "kube-api-access-hzqrs") pod "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc"). InnerVolumeSpecName "kube-api-access-hzqrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:29:07.466147 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.466021    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" (UID: "0a09aa66-b47e-40f0-bcd2-0bbc05c905fc"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:07.565482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.565453    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:07.565482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.565477    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:07.565482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.565486    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:07.565690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.565494    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:07.565690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.565503    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzqrs\" (UniqueName: \"kubernetes.io/projected/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-kube-api-access-hzqrs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:07.565690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.565514    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:07.784706 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.784673    2552 generic.go:356] "Generic (PLEG): container finished" podID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerID="2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e" exitCode=137
Jun 10 10:29:07.784875 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.784716    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerDied","Data":"2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e"}
Jun 10 10:29:07.784875 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.784737    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"
Jun 10 10:29:07.784875 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.784767    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj" event={"ID":"0a09aa66-b47e-40f0-bcd2-0bbc05c905fc","Type":"ContainerDied","Data":"75daec20cb4ccec5fd1892617e468fe67a56e5b63e643b0566979da3488b00a0"}
Jun 10 10:29:07.784875 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.784795    2552 scope.go:117] "RemoveContainer" containerID="fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240"
Jun 10 10:29:07.788627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.788597    2552 generic.go:356] "Generic (PLEG): container finished" podID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerID="9f451630a1f2664d37673e31d691445444a818ae9178465c9edac7adf83d3ea1" exitCode=137
Jun 10 10:29:07.788627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.788625    2552 generic.go:356] "Generic (PLEG): container finished" podID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerID="8aa692f5dd8118f29e068bfe2719621fbd1db5cd8b91185502aa23859d73a7e7" exitCode=137
Jun 10 10:29:07.788805 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.788644    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"9f451630a1f2664d37673e31d691445444a818ae9178465c9edac7adf83d3ea1"}
Jun 10 10:29:07.788805 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.788689    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"8aa692f5dd8118f29e068bfe2719621fbd1db5cd8b91185502aa23859d73a7e7"}
Jun 10 10:29:07.794349 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.794311    2552 scope.go:117] "RemoveContainer" containerID="2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e"
Jun 10 10:29:07.802075 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.802059    2552 scope.go:117] "RemoveContainer" containerID="5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa"
Jun 10 10:29:07.808357 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.808336    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"]
Jun 10 10:29:07.811467 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.811449    2552 scope.go:117] "RemoveContainer" containerID="87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152"
Jun 10 10:29:07.812730 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.812709    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5b766b898-svsgj"]
Jun 10 10:29:07.818891 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.818864    2552 scope.go:117] "RemoveContainer" containerID="d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679"
Jun 10 10:29:07.826188 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.826168    2552 scope.go:117] "RemoveContainer" containerID="fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240"
Jun 10 10:29:07.826448 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:07.826420    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240\": container with ID starting with fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240 not found: ID does not exist" containerID="fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240"
Jun 10 10:29:07.826520 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.826449    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240"} err="failed to get container status \"fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240\": rpc error: code = NotFound desc = could not find container \"fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240\": container with ID starting with fbcdb8bf5a4bd88275574b999773bec027a13ffb326f5a0af29dfdeb768d7240 not found: ID does not exist"
Jun 10 10:29:07.826520 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.826474    2552 scope.go:117] "RemoveContainer" containerID="2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e"
Jun 10 10:29:07.826748 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:07.826724    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e\": container with ID starting with 2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e not found: ID does not exist" containerID="2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e"
Jun 10 10:29:07.826824 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.826759    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e"} err="failed to get container status \"2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e\": rpc error: code = NotFound desc = could not find container \"2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e\": container with ID starting with 2510b2f88318efdabfde31469942e9cbe3de196af9f4c00c94e3e63fbfb3253e not found: ID does not exist"
Jun 10 10:29:07.826824 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.826783    2552 scope.go:117] "RemoveContainer" containerID="5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa"
Jun 10 10:29:07.827378 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:07.827349    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa\": container with ID starting with 5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa not found: ID does not exist" containerID="5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa"
Jun 10 10:29:07.827483 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.827387    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa"} err="failed to get container status \"5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa\": rpc error: code = NotFound desc = could not find container \"5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa\": container with ID starting with 5d6a1bcfc2c1298396316da830e9d8124f7704354c70445cd2f17f26c2bc3eaa not found: ID does not exist"
Jun 10 10:29:07.827483 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.827412    2552 scope.go:117] "RemoveContainer" containerID="87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152"
Jun 10 10:29:07.828103 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:07.828078    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152\": container with ID starting with 87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152 not found: ID does not exist" containerID="87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152"
Jun 10 10:29:07.828193 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.828109    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152"} err="failed to get container status \"87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152\": rpc error: code = NotFound desc = could not find container \"87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152\": container with ID starting with 87ed01ee082760bb4ea942d43cefdca0bf1f941319bd9db5ebcc1ef09f809152 not found: ID does not exist"
Jun 10 10:29:07.828193 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.828131    2552 scope.go:117] "RemoveContainer" containerID="d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679"
Jun 10 10:29:07.828471 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:07.828453    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679\": container with ID starting with d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679 not found: ID does not exist" containerID="d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679"
Jun 10 10:29:07.828597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.828475    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679"} err="failed to get container status \"d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679\": rpc error: code = NotFound desc = could not find container \"d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679\": container with ID starting with d14d9af9ea964db6253584663c6f39bfc8b0854e214b2734a8659a00a46f0679 not found: ID does not exist"
Jun 10 10:29:07.886158 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.886132    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:29:07.969385 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.969360    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls\") pod \"924946ee-dc75-4c7f-8e6e-86203aa3e452\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") "
Jun 10 10:29:07.969548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.969402    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx4t7\" (UniqueName: \"kubernetes.io/projected/924946ee-dc75-4c7f-8e6e-86203aa3e452-kube-api-access-lx4t7\") pod \"924946ee-dc75-4c7f-8e6e-86203aa3e452\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") "
Jun 10 10:29:07.969548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.969429    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/924946ee-dc75-4c7f-8e6e-86203aa3e452-feast-data\") pod \"924946ee-dc75-4c7f-8e6e-86203aa3e452\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") "
Jun 10 10:29:07.969548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.969454    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-registry-tls\") pod \"924946ee-dc75-4c7f-8e6e-86203aa3e452\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") "
Jun 10 10:29:07.969548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.969496    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-online-tls\") pod \"924946ee-dc75-4c7f-8e6e-86203aa3e452\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") "
Jun 10 10:29:07.969548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.969524    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-ui-tls\") pod \"924946ee-dc75-4c7f-8e6e-86203aa3e452\" (UID: \"924946ee-dc75-4c7f-8e6e-86203aa3e452\") "
Jun 10 10:29:07.970025 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.970001    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924946ee-dc75-4c7f-8e6e-86203aa3e452-feast-data" (OuterVolumeSpecName: "feast-data") pod "924946ee-dc75-4c7f-8e6e-86203aa3e452" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:29:07.971648 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.971619    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "924946ee-dc75-4c7f-8e6e-86203aa3e452" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:07.971648 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.971636    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-online-tls" (OuterVolumeSpecName: "online-tls") pod "924946ee-dc75-4c7f-8e6e-86203aa3e452" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:07.971765 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.971666    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924946ee-dc75-4c7f-8e6e-86203aa3e452-kube-api-access-lx4t7" (OuterVolumeSpecName: "kube-api-access-lx4t7") pod "924946ee-dc75-4c7f-8e6e-86203aa3e452" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452"). InnerVolumeSpecName "kube-api-access-lx4t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:29:07.971920 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.971888    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "924946ee-dc75-4c7f-8e6e-86203aa3e452" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:07.971989 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:07.971901    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "924946ee-dc75-4c7f-8e6e-86203aa3e452" (UID: "924946ee-dc75-4c7f-8e6e-86203aa3e452"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:29:08.070338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.070273    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:08.070338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.070294    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:08.070338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.070302    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:08.070338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.070312    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx4t7\" (UniqueName: \"kubernetes.io/projected/924946ee-dc75-4c7f-8e6e-86203aa3e452-kube-api-access-lx4t7\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:08.070338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.070320    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/924946ee-dc75-4c7f-8e6e-86203aa3e452-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:08.070338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.070328    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/924946ee-dc75-4c7f-8e6e-86203aa3e452-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:29:08.579553 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.579522    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" path="/var/lib/kubelet/pods/0a09aa66-b47e-40f0-bcd2-0bbc05c905fc/volumes"
Jun 10 10:29:08.797858 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.797827    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"
Jun 10 10:29:08.798046 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.797825    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf" event={"ID":"924946ee-dc75-4c7f-8e6e-86203aa3e452","Type":"ContainerDied","Data":"b0466e5492ac128f3ef52836f6fe9139f3b80623a2a61c21aa71e22bf6bdff4a"}
Jun 10 10:29:08.798046 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.797948    2552 scope.go:117] "RemoveContainer" containerID="3fa64a9dd0aeaed75bdfbfddb654b349d4b428a245e0cf009f61759045855715"
Jun 10 10:29:08.806205 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.806185    2552 scope.go:117] "RemoveContainer" containerID="9f451630a1f2664d37673e31d691445444a818ae9178465c9edac7adf83d3ea1"
Jun 10 10:29:08.813420 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.813404    2552 scope.go:117] "RemoveContainer" containerID="6f7f7855bd0bd32c7bf1ccb5142f6b5292177f933d45a0d06d3714a56b6f6ecd"
Jun 10 10:29:08.817482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.817457    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"]
Jun 10 10:29:08.821546 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.821525    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-84d578cf8-jdxsf"]
Jun 10 10:29:08.821688 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.821668    2552 scope.go:117] "RemoveContainer" containerID="8aa692f5dd8118f29e068bfe2719621fbd1db5cd8b91185502aa23859d73a7e7"
Jun 10 10:29:08.828799 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.828783    2552 scope.go:117] "RemoveContainer" containerID="c491d06ef1e33b0eab9bc592b88cc0114a5068756087bdbec3ec5fa40afbbe3d"
Jun 10 10:29:08.835418 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:08.835402    2552 scope.go:117] "RemoveContainer" containerID="fe1c3f14712020ddccc754efd9806b9c1d0584b935ffa2d3ca086c61fddc41f8"
Jun 10 10:29:10.579657 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:10.579615    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" path="/var/lib/kubelet/pods/924946ee-dc75-4c7f-8e6e-86203aa3e452/volumes"
Jun 10 10:29:20.341612 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341578    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-j65t9"]
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341952    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341965    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341976    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="feast-init"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341981    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="feast-init"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341990    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.341999    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342031    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="feast-apply"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342037    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="feast-apply"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342043    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="feast-apply"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342048    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="feast-apply"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342054    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="registry"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342059    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="registry"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342065    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="offline"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342072    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="offline"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342081    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="feast-init"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342086    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="feast-init"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342093    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342098    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342103    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="offline"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342117    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="offline"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342125    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online"
Jun 10 10:29:20.342140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342130    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342185    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="ui"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342193    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="offline"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342201    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="registry"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342207    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="offline"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342214    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="online"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342221    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="924946ee-dc75-4c7f-8e6e-86203aa3e452" containerName="ui"
Jun 10 10:29:20.342879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.342229    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a09aa66-b47e-40f0-bcd2-0bbc05c905fc" containerName="online"
Jun 10 10:29:20.347243 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.347224    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.349878 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.349859    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-krvdh\""
Jun 10 10:29:20.350072 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.350049    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 10 10:29:20.350953 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.350935    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 10 10:29:20.351046 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.350935    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 10 10:29:20.353246 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.353223    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-j65t9"]
Jun 10 10:29:20.389780 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.389747    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-xljbd"]
Jun 10 10:29:20.393118 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.393097    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:29:20.400748 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.400723    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-xljbd"]
Jun 10 10:29:20.475054 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.475024    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2n6\" (UniqueName: \"kubernetes.io/projected/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-kube-api-access-sj2n6\") pod \"postgres-864846d4f5-j65t9\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") " pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.475199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.475075    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-postgresdata\") pod \"postgres-864846d4f5-j65t9\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") " pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.475199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.475172    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrcct\" (UniqueName: \"kubernetes.io/projected/45c0d989-3199-4474-bf25-253261b9ebec-kube-api-access-nrcct\") pod \"redis-69bbd798b6-xljbd\" (UID: \"45c0d989-3199-4474-bf25-253261b9ebec\") " pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:29:20.576239 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.576205    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-postgresdata\") pod \"postgres-864846d4f5-j65t9\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") " pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.576410 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.576255    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrcct\" (UniqueName: \"kubernetes.io/projected/45c0d989-3199-4474-bf25-253261b9ebec-kube-api-access-nrcct\") pod \"redis-69bbd798b6-xljbd\" (UID: \"45c0d989-3199-4474-bf25-253261b9ebec\") " pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:29:20.576410 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.576289    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2n6\" (UniqueName: \"kubernetes.io/projected/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-kube-api-access-sj2n6\") pod \"postgres-864846d4f5-j65t9\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") " pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.576593 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.576568    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-postgresdata\") pod \"postgres-864846d4f5-j65t9\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") " pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.590331 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.590301    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2n6\" (UniqueName: \"kubernetes.io/projected/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-kube-api-access-sj2n6\") pod \"postgres-864846d4f5-j65t9\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") " pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.591496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.591476    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrcct\" (UniqueName: \"kubernetes.io/projected/45c0d989-3199-4474-bf25-253261b9ebec-kube-api-access-nrcct\") pod \"redis-69bbd798b6-xljbd\" (UID: \"45c0d989-3199-4474-bf25-253261b9ebec\") " pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:29:20.668240 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.668208    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:29:20.702655 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.702629    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:29:20.808661 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.808631    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-j65t9"]
Jun 10 10:29:20.814018 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:29:20.813988    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf412b42d_f7e7_4a67_ac8e_23b2c1fa7a0e.slice/crio-e979f58864e9897735e5b25dda30ea2560fc95006c35948087e0ba9dbf2340ab WatchSource:0}: Error finding container e979f58864e9897735e5b25dda30ea2560fc95006c35948087e0ba9dbf2340ab: Status 404 returned error can't find the container with id e979f58864e9897735e5b25dda30ea2560fc95006c35948087e0ba9dbf2340ab
Jun 10 10:29:20.815857 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.815841    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 10:29:20.851289 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.851258    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-j65t9" event={"ID":"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e","Type":"ContainerStarted","Data":"e979f58864e9897735e5b25dda30ea2560fc95006c35948087e0ba9dbf2340ab"}
Jun 10 10:29:20.856185 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:20.856079    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-xljbd"]
Jun 10 10:29:20.858596 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:29:20.858573    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45c0d989_3199_4474_bf25_253261b9ebec.slice/crio-e0e81d690f6a3822d0f098805ebd1028ad337aa5c041ec30eecd0b6ef24a2527 WatchSource:0}: Error finding container e0e81d690f6a3822d0f098805ebd1028ad337aa5c041ec30eecd0b6ef24a2527: Status 404 returned error can't find the container with id e0e81d690f6a3822d0f098805ebd1028ad337aa5c041ec30eecd0b6ef24a2527
Jun 10 10:29:21.856702 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:21.856653    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-xljbd" event={"ID":"45c0d989-3199-4474-bf25-253261b9ebec","Type":"ContainerStarted","Data":"e0e81d690f6a3822d0f098805ebd1028ad337aa5c041ec30eecd0b6ef24a2527"}
Jun 10 10:29:22.862765 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:22.862736    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-xljbd" event={"ID":"45c0d989-3199-4474-bf25-253261b9ebec","Type":"ContainerStarted","Data":"ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae"}
Jun 10 10:29:22.907701 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:22.907650    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-xljbd" podStartSLOduration=1.248263456 podStartE2EDuration="2.907628894s" totalImagesPullingTime="1.659365438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:29:22.906750336 +0000 UTC m=+650.763686768" watchObservedRunningTime="2026-06-10 10:29:22.907628894 +0000 UTC m=+650.764565328"
Jun 10 10:29:26.886789 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:26.886758    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-j65t9" event={"ID":"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e","Type":"ContainerStarted","Data":"64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb"}
Jun 10 10:29:26.907696 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:26.907644    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-j65t9" podStartSLOduration=1.021415839 podStartE2EDuration="6.907627961s" totalImagesPullingTime="5.886212122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:29:26.90679856 +0000 UTC m=+654.763734995" watchObservedRunningTime="2026-06-10 10:29:26.907627961 +0000 UTC m=+654.764564391"
Jun 10 10:29:31.086842 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.086808    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-676f48d675-7kphj"]
Jun 10 10:29:31.093791 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.093772    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.097089 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.097064    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 10 10:29:31.097407 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.097393    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 10 10:29:31.097462 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.097428    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 10 10:29:31.097979 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.097961    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-cj455\""
Jun 10 10:29:31.098048 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.098000    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 10 10:29:31.103734 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.103715    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-676f48d675-7kphj"]
Jun 10 10:29:31.185378 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.185348    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.185378 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.185384    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/118728fd-a80d-411a-92a5-d2ee49169862-feast-data\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.185603 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.185411    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-922wn\" (UniqueName: \"kubernetes.io/projected/118728fd-a80d-411a-92a5-d2ee49169862-kube-api-access-922wn\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.185603 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.185478    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-online-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.185603 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.185526    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-registry-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.286800 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.286776    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-922wn\" (UniqueName: \"kubernetes.io/projected/118728fd-a80d-411a-92a5-d2ee49169862-kube-api-access-922wn\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.286963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.286812    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-online-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.286963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.286838    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-registry-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.286963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.286883    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.286963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.286898    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/118728fd-a80d-411a-92a5-d2ee49169862-feast-data\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.287164 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:31.287035    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Jun 10 10:29:31.287164 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:29:31.287111    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls podName:118728fd-a80d-411a-92a5-d2ee49169862 nodeName:}" failed. No retries permitted until 2026-06-10 10:29:31.787091221 +0000 UTC m=+659.644027641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls") pod "feast-credit-scoring-676f48d675-7kphj" (UID: "118728fd-a80d-411a-92a5-d2ee49169862") : secret "feast-credit-scoring-offline-tls" not found
Jun 10 10:29:31.287280 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.287230    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/118728fd-a80d-411a-92a5-d2ee49169862-feast-data\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.289284 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.289263    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-registry-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.289370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.289312    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-online-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.295024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.294998    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-922wn\" (UniqueName: \"kubernetes.io/projected/118728fd-a80d-411a-92a5-d2ee49169862-kube-api-access-922wn\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.791779 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.791746    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:31.794158 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:31.794132    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls\") pod \"feast-credit-scoring-676f48d675-7kphj\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") " pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:32.003595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:32.003561    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:32.162453 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:32.162426    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-676f48d675-7kphj"]
Jun 10 10:29:32.164099 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:29:32.164078    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118728fd_a80d_411a_92a5_d2ee49169862.slice/crio-d77d6e2b8b578447137651d77ca40855526898ae6a6d4bda58b3e9af464b9a37 WatchSource:0}: Error finding container d77d6e2b8b578447137651d77ca40855526898ae6a6d4bda58b3e9af464b9a37: Status 404 returned error can't find the container with id d77d6e2b8b578447137651d77ca40855526898ae6a6d4bda58b3e9af464b9a37
Jun 10 10:29:32.920389 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:32.920349    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerStarted","Data":"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"}
Jun 10 10:29:32.920587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:32.920429    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerStarted","Data":"d77d6e2b8b578447137651d77ca40855526898ae6a6d4bda58b3e9af464b9a37"}
Jun 10 10:29:33.926027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:33.925997    2552 generic.go:356] "Generic (PLEG): container finished" podID="118728fd-a80d-411a-92a5-d2ee49169862" containerID="7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c" exitCode=0
Jun 10 10:29:33.926384 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:33.926045    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerDied","Data":"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"}
Jun 10 10:29:34.933123 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:34.933092    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerStarted","Data":"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"}
Jun 10 10:29:40.966428 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:40.966396    2552 generic.go:356] "Generic (PLEG): container finished" podID="118728fd-a80d-411a-92a5-d2ee49169862" containerID="bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712" exitCode=0
Jun 10 10:29:40.966948 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:40.966468    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerDied","Data":"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"}
Jun 10 10:29:40.970448 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:40.970423    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 10 10:29:41.974960 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:41.974922    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerStarted","Data":"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"}
Jun 10 10:29:41.975431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:41.974982    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerStarted","Data":"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"}
Jun 10 10:29:41.975431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:41.975000    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerStarted","Data":"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"}
Jun 10 10:29:42.004508 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:42.004467    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:42.004684 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:42.004538    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:42.004684 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:42.004557    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:42.011862 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:42.011803    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podStartSLOduration=11.011789269 podStartE2EDuration="11.011789269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:29:42.01118907 +0000 UTC m=+669.868125503" watchObservedRunningTime="2026-06-10 10:29:42.011789269 +0000 UTC m=+669.868725700"
Jun 10 10:29:44.004728 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:44.004694    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:44.005211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:44.004773    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:44.005211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:44.004800    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:44.006571 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:44.006535    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused"
Jun 10 10:29:44.006696 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:44.006560    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
Jun 10 10:29:44.006696 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:44.006579    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 10 10:29:47.004892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:47.004854    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
Jun 10 10:29:47.005810 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:47.005787    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:47.006462 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:47.006441    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:47.010138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:47.010110    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:48.008045 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:48.008014    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:50.003997 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:50.003951    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
Jun 10 10:29:53.005398 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:53.005362    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:29:53.006067 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:29:53.006051    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:30:57.438888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.438856    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-676f48d675-7kphj"]
Jun 10 10:30:57.439441 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.439081    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry" containerID="cri-o://fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef" gracePeriod=30
Jun 10 10:30:57.439441 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.439137    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online" containerID="cri-o://769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce" gracePeriod=30
Jun 10 10:30:57.439441 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.439167    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="offline" containerID="cri-o://3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725" gracePeriod=30
Jun 10 10:30:57.478066 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.478035    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-j65t9"]
Jun 10 10:30:57.478251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.478232    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-j65t9" podUID="f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" containerName="postgres" containerID="cri-o://64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb" gracePeriod=30
Jun 10 10:30:57.492992 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.492894    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-xljbd"]
Jun 10 10:30:57.493151 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.493108    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-xljbd" podUID="45c0d989-3199-4474-bf25-253261b9ebec" containerName="redis" containerID="cri-o://ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae" gracePeriod=30
Jun 10 10:30:57.738154 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.738132    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:30:57.765798 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.765777    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:30:57.771938 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.771919    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj2n6\" (UniqueName: \"kubernetes.io/projected/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-kube-api-access-sj2n6\") pod \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") "
Jun 10 10:30:57.772049 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.771953    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-postgresdata\") pod \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\" (UID: \"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e\") "
Jun 10 10:30:57.772049 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.771972    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrcct\" (UniqueName: \"kubernetes.io/projected/45c0d989-3199-4474-bf25-253261b9ebec-kube-api-access-nrcct\") pod \"45c0d989-3199-4474-bf25-253261b9ebec\" (UID: \"45c0d989-3199-4474-bf25-253261b9ebec\") "
Jun 10 10:30:57.773888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.773861    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-kube-api-access-sj2n6" (OuterVolumeSpecName: "kube-api-access-sj2n6") pod "f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" (UID: "f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e"). InnerVolumeSpecName "kube-api-access-sj2n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:30:57.773989 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.773951    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c0d989-3199-4474-bf25-253261b9ebec-kube-api-access-nrcct" (OuterVolumeSpecName: "kube-api-access-nrcct") pod "45c0d989-3199-4474-bf25-253261b9ebec" (UID: "45c0d989-3199-4474-bf25-253261b9ebec"). InnerVolumeSpecName "kube-api-access-nrcct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:30:57.802255 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.802225    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" (UID: "f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:30:57.873369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.873337    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrcct\" (UniqueName: \"kubernetes.io/projected/45c0d989-3199-4474-bf25-253261b9ebec-kube-api-access-nrcct\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:30:57.873369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.873363    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj2n6\" (UniqueName: \"kubernetes.io/projected/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-kube-api-access-sj2n6\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:30:57.873369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:57.873373    2552 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e-postgresdata\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:30:58.005722 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.005629    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 10 10:30:58.319480 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.319392    2552 generic.go:356] "Generic (PLEG): container finished" podID="f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" containerID="64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb" exitCode=0
Jun 10 10:30:58.319480 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.319431    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-j65t9"
Jun 10 10:30:58.319480 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.319440    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-j65t9" event={"ID":"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e","Type":"ContainerDied","Data":"64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb"}
Jun 10 10:30:58.319763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.319488    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-j65t9" event={"ID":"f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e","Type":"ContainerDied","Data":"e979f58864e9897735e5b25dda30ea2560fc95006c35948087e0ba9dbf2340ab"}
Jun 10 10:30:58.319763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.319511    2552 scope.go:117] "RemoveContainer" containerID="64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb"
Jun 10 10:30:58.320780 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.320761    2552 generic.go:356] "Generic (PLEG): container finished" podID="45c0d989-3199-4474-bf25-253261b9ebec" containerID="ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae" exitCode=0
Jun 10 10:30:58.320884 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.320804    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-xljbd"
Jun 10 10:30:58.320884 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.320846    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-xljbd" event={"ID":"45c0d989-3199-4474-bf25-253261b9ebec","Type":"ContainerDied","Data":"ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae"}
Jun 10 10:30:58.321031 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.320891    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-xljbd" event={"ID":"45c0d989-3199-4474-bf25-253261b9ebec","Type":"ContainerDied","Data":"e0e81d690f6a3822d0f098805ebd1028ad337aa5c041ec30eecd0b6ef24a2527"}
Jun 10 10:30:58.323887 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.323864    2552 generic.go:356] "Generic (PLEG): container finished" podID="118728fd-a80d-411a-92a5-d2ee49169862" containerID="769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce" exitCode=0
Jun 10 10:30:58.323998 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.323925    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerDied","Data":"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"}
Jun 10 10:30:58.331003 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.330984    2552 scope.go:117] "RemoveContainer" containerID="64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb"
Jun 10 10:30:58.331279 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:30:58.331259    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb\": container with ID starting with 64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb not found: ID does not exist" containerID="64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb"
Jun 10 10:30:58.331359 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.331283    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb"} err="failed to get container status \"64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb\": rpc error: code = NotFound desc = could not find container \"64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb\": container with ID starting with 64c9198a71023b1b686073e3b1b7d728229cc301ee5d9a1cb316e8047c1e5dcb not found: ID does not exist"
Jun 10 10:30:58.331359 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.331298    2552 scope.go:117] "RemoveContainer" containerID="ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae"
Jun 10 10:30:58.338443 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.338425    2552 scope.go:117] "RemoveContainer" containerID="ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae"
Jun 10 10:30:58.338695 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:30:58.338676    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae\": container with ID starting with ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae not found: ID does not exist" containerID="ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae"
Jun 10 10:30:58.338769 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.338702    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae"} err="failed to get container status \"ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae\": rpc error: code = NotFound desc = could not find container \"ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae\": container with ID starting with ab631a1cc6e1ba1e6d83c1d9b281a9c341d067c3e2dbda157d6d6d7f053bd2ae not found: ID does not exist"
Jun 10 10:30:58.355019 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.355000    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-xljbd"]
Jun 10 10:30:58.358993 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.358972    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-xljbd"]
Jun 10 10:30:58.372166 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.372150    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-j65t9"]
Jun 10 10:30:58.378945 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.378926    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-j65t9"]
Jun 10 10:30:58.579485 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.579413    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45c0d989-3199-4474-bf25-253261b9ebec" path="/var/lib/kubelet/pods/45c0d989-3199-4474-bf25-253261b9ebec/volumes"
Jun 10 10:30:58.579950 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:30:58.579901    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" path="/var/lib/kubelet/pods/f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e/volumes"
Jun 10 10:31:08.005867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:08.005831    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 10 10:31:18.005024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:18.004980    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 10 10:31:18.005508 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:18.005124    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:31:28.005418 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.005368    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
Jun 10 10:31:28.091532 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.091507    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:31:28.224237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.224146    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-922wn\" (UniqueName: \"kubernetes.io/projected/118728fd-a80d-411a-92a5-d2ee49169862-kube-api-access-922wn\") pod \"118728fd-a80d-411a-92a5-d2ee49169862\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") "
Jun 10 10:31:28.224237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.224194    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-registry-tls\") pod \"118728fd-a80d-411a-92a5-d2ee49169862\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") "
Jun 10 10:31:28.224237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.224235    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-online-tls\") pod \"118728fd-a80d-411a-92a5-d2ee49169862\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") "
Jun 10 10:31:28.224587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.224252    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls\") pod \"118728fd-a80d-411a-92a5-d2ee49169862\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") "
Jun 10 10:31:28.224587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.224282    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/118728fd-a80d-411a-92a5-d2ee49169862-feast-data\") pod \"118728fd-a80d-411a-92a5-d2ee49169862\" (UID: \"118728fd-a80d-411a-92a5-d2ee49169862\") "
Jun 10 10:31:28.226390 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.226356    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "118728fd-a80d-411a-92a5-d2ee49169862" (UID: "118728fd-a80d-411a-92a5-d2ee49169862"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:31:28.226506 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.226420    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118728fd-a80d-411a-92a5-d2ee49169862-kube-api-access-922wn" (OuterVolumeSpecName: "kube-api-access-922wn") pod "118728fd-a80d-411a-92a5-d2ee49169862" (UID: "118728fd-a80d-411a-92a5-d2ee49169862"). InnerVolumeSpecName "kube-api-access-922wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:31:28.226506 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.226445    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "118728fd-a80d-411a-92a5-d2ee49169862" (UID: "118728fd-a80d-411a-92a5-d2ee49169862"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:31:28.226664 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.226638    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-online-tls" (OuterVolumeSpecName: "online-tls") pod "118728fd-a80d-411a-92a5-d2ee49169862" (UID: "118728fd-a80d-411a-92a5-d2ee49169862"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:31:28.232729 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.232707    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118728fd-a80d-411a-92a5-d2ee49169862-feast-data" (OuterVolumeSpecName: "feast-data") pod "118728fd-a80d-411a-92a5-d2ee49169862" (UID: "118728fd-a80d-411a-92a5-d2ee49169862"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:31:28.325495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.325456    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:31:28.325495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.325487    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:31:28.325495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.325495    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/118728fd-a80d-411a-92a5-d2ee49169862-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:31:28.325495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.325504    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-922wn\" (UniqueName: \"kubernetes.io/projected/118728fd-a80d-411a-92a5-d2ee49169862-kube-api-access-922wn\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:31:28.325738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.325512    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/118728fd-a80d-411a-92a5-d2ee49169862-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:31:28.448588 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448557    2552 generic.go:356] "Generic (PLEG): container finished" podID="118728fd-a80d-411a-92a5-d2ee49169862" containerID="3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725" exitCode=137
Jun 10 10:31:28.448588 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448582    2552 generic.go:356] "Generic (PLEG): container finished" podID="118728fd-a80d-411a-92a5-d2ee49169862" containerID="fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef" exitCode=137
Jun 10 10:31:28.448782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448633    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerDied","Data":"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"}
Jun 10 10:31:28.448782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448695    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerDied","Data":"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"}
Jun 10 10:31:28.448782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448714    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj" event={"ID":"118728fd-a80d-411a-92a5-d2ee49169862","Type":"ContainerDied","Data":"d77d6e2b8b578447137651d77ca40855526898ae6a6d4bda58b3e9af464b9a37"}
Jun 10 10:31:28.448782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448647    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-676f48d675-7kphj"
Jun 10 10:31:28.448782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.448742    2552 scope.go:117] "RemoveContainer" containerID="3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"
Jun 10 10:31:28.457629 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.457612    2552 scope.go:117] "RemoveContainer" containerID="769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"
Jun 10 10:31:28.465614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.465599    2552 scope.go:117] "RemoveContainer" containerID="fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"
Jun 10 10:31:28.473704 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.473686    2552 scope.go:117] "RemoveContainer" containerID="bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"
Jun 10 10:31:28.480958 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.480942    2552 scope.go:117] "RemoveContainer" containerID="7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"
Jun 10 10:31:28.489489 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.489124    2552 scope.go:117] "RemoveContainer" containerID="3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"
Jun 10 10:31:28.490207 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:31:28.490177    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725\": container with ID starting with 3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725 not found: ID does not exist" containerID="3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"
Jun 10 10:31:28.490350 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.490218    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"} err="failed to get container status \"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725\": rpc error: code = NotFound desc = could not find container \"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725\": container with ID starting with 3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725 not found: ID does not exist"
Jun 10 10:31:28.490350 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.490243    2552 scope.go:117] "RemoveContainer" containerID="769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"
Jun 10 10:31:28.490649 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:31:28.490625    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce\": container with ID starting with 769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce not found: ID does not exist" containerID="769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"
Jun 10 10:31:28.490763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.490657    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"} err="failed to get container status \"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce\": rpc error: code = NotFound desc = could not find container \"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce\": container with ID starting with 769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce not found: ID does not exist"
Jun 10 10:31:28.490763 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.490677    2552 scope.go:117] "RemoveContainer" containerID="fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"
Jun 10 10:31:28.491241 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:31:28.491118    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef\": container with ID starting with fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef not found: ID does not exist" containerID="fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"
Jun 10 10:31:28.491241 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.491149    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"} err="failed to get container status \"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef\": rpc error: code = NotFound desc = could not find container \"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef\": container with ID starting with fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef not found: ID does not exist"
Jun 10 10:31:28.491241 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.491169    2552 scope.go:117] "RemoveContainer" containerID="bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"
Jun 10 10:31:28.491610 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:31:28.491548    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712\": container with ID starting with bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712 not found: ID does not exist" containerID="bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"
Jun 10 10:31:28.491610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.491577    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"} err="failed to get container status \"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712\": rpc error: code = NotFound desc = could not find container \"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712\": container with ID starting with bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712 not found: ID does not exist"
Jun 10 10:31:28.491610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.491598    2552 scope.go:117] "RemoveContainer" containerID="7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"
Jun 10 10:31:28.491874 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:31:28.491838    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c\": container with ID starting with 7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c not found: ID does not exist" containerID="7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"
Jun 10 10:31:28.491874 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.491873    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"} err="failed to get container status \"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c\": rpc error: code = NotFound desc = could not find container \"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c\": container with ID starting with 7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c not found: ID does not exist"
Jun 10 10:31:28.492019 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.491892    2552 scope.go:117] "RemoveContainer" containerID="3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"
Jun 10 10:31:28.492178 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492156    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725"} err="failed to get container status \"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725\": rpc error: code = NotFound desc = could not find container \"3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725\": container with ID starting with 3c9fee370132fa529eb3af2dc542031562817dcb899680eff233ec3708b92725 not found: ID does not exist"
Jun 10 10:31:28.492263 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492181    2552 scope.go:117] "RemoveContainer" containerID="769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"
Jun 10 10:31:28.492459 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492441    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce"} err="failed to get container status \"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce\": rpc error: code = NotFound desc = could not find container \"769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce\": container with ID starting with 769190c166f06c53ec737958bcdadc827da791d87bb341aa9524029246cefdce not found: ID does not exist"
Jun 10 10:31:28.492525 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492459    2552 scope.go:117] "RemoveContainer" containerID="fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"
Jun 10 10:31:28.492688 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492672    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef"} err="failed to get container status \"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef\": rpc error: code = NotFound desc = could not find container \"fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef\": container with ID starting with fd22a5ec8eababb27dff43a5932fbfe8e96db11fbe31f12c747364f0dacfe6ef not found: ID does not exist"
Jun 10 10:31:28.492736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492687    2552 scope.go:117] "RemoveContainer" containerID="bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"
Jun 10 10:31:28.492809 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492767    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-676f48d675-7kphj"]
Jun 10 10:31:28.492884 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492866    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712"} err="failed to get container status \"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712\": rpc error: code = NotFound desc = could not find container \"bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712\": container with ID starting with bd71411b8eb0010b059b187dfe485fb991ec1c85f093131d0e393990f5b70712 not found: ID does not exist"
Jun 10 10:31:28.492956 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.492886    2552 scope.go:117] "RemoveContainer" containerID="7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"
Jun 10 10:31:28.493101 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.493080    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c"} err="failed to get container status \"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c\": rpc error: code = NotFound desc = could not find container \"7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c\": container with ID starting with 7b0f0ea4d00ee0eef16b0f4829efd6e2928d2991cebc1258a33041095dd9737c not found: ID does not exist"
Jun 10 10:31:28.505545 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.505521    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-676f48d675-7kphj"]
Jun 10 10:31:28.579396 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:31:28.579366    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="118728fd-a80d-411a-92a5-d2ee49169862" path="/var/lib/kubelet/pods/118728fd-a80d-411a-92a5-d2ee49169862/volumes"
Jun 10 10:33:12.450471 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450439    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tzzmr"]
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450754    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450766    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450779    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="feast-init"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450785    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="feast-init"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450797    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450802    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450809    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="offline"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450815    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="offline"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450831    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45c0d989-3199-4474-bf25-253261b9ebec" containerName="redis"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450837    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="45c0d989-3199-4474-bf25-253261b9ebec" containerName="redis"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450853    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" containerName="postgres"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450860    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" containerName="postgres"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450868    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="feast-apply"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450875    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="feast-apply"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450954    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="online"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450964    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="offline"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450973    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f412b42d-f7e7-4a67-ac8e-23b2c1fa7a0e" containerName="postgres"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450984    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="118728fd-a80d-411a-92a5-d2ee49169862" containerName="registry"
Jun 10 10:33:12.451026 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.450993    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="45c0d989-3199-4474-bf25-253261b9ebec" containerName="redis"
Jun 10 10:33:12.453835 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.453818    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:33:12.460622 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.460606    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 10 10:33:12.460622 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.460611    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-j66lt\""
Jun 10 10:33:12.461050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.461029    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 10 10:33:12.475099 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.475075    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tzzmr"]
Jun 10 10:33:12.542393 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.542347    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p76bj\" (UniqueName: \"kubernetes.io/projected/f423d842-f546-4d10-b655-31cb3a6bd4af-kube-api-access-p76bj\") pod \"redis-69bbd798b6-tzzmr\" (UID: \"f423d842-f546-4d10-b655-31cb3a6bd4af\") " pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:33:12.642964 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.642892    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p76bj\" (UniqueName: \"kubernetes.io/projected/f423d842-f546-4d10-b655-31cb3a6bd4af-kube-api-access-p76bj\") pod \"redis-69bbd798b6-tzzmr\" (UID: \"f423d842-f546-4d10-b655-31cb3a6bd4af\") " pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:33:12.651782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.651750    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p76bj\" (UniqueName: \"kubernetes.io/projected/f423d842-f546-4d10-b655-31cb3a6bd4af-kube-api-access-p76bj\") pod \"redis-69bbd798b6-tzzmr\" (UID: \"f423d842-f546-4d10-b655-31cb3a6bd4af\") " pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:33:12.774426 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.774336    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:33:12.914574 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:12.914503    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tzzmr"]
Jun 10 10:33:12.917264 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:33:12.917237    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf423d842_f546_4d10_b655_31cb3a6bd4af.slice/crio-7dfc55f6b731667a5b283755f4f517af23019afb714f89cfccfce10fbe209f01 WatchSource:0}: Error finding container 7dfc55f6b731667a5b283755f4f517af23019afb714f89cfccfce10fbe209f01: Status 404 returned error can't find the container with id 7dfc55f6b731667a5b283755f4f517af23019afb714f89cfccfce10fbe209f01
Jun 10 10:33:13.870745 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:13.870704    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr" event={"ID":"f423d842-f546-4d10-b655-31cb3a6bd4af","Type":"ContainerStarted","Data":"58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382"}
Jun 10 10:33:13.870745 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:13.870748    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr" event={"ID":"f423d842-f546-4d10-b655-31cb3a6bd4af","Type":"ContainerStarted","Data":"7dfc55f6b731667a5b283755f4f517af23019afb714f89cfccfce10fbe209f01"}
Jun 10 10:33:13.886659 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:13.886608    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr" podStartSLOduration=1.886592206 podStartE2EDuration="1.886592206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:33:13.885448524 +0000 UTC m=+881.742384985" watchObservedRunningTime="2026-06-10 10:33:13.886592206 +0000 UTC m=+881.743528637"
Jun 10 10:33:18.013984 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.013951    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h4bf9"]
Jun 10 10:33:18.017470 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.017449    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.020928 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.020883    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 10 10:33:18.025996 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.025972    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h4bf9"]
Jun 10 10:33:18.085582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.085534    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-postgresdata\") pod \"postgres-864846d4f5-h4bf9\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") " pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.085767 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.085609    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gb4l\" (UniqueName: \"kubernetes.io/projected/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-kube-api-access-4gb4l\") pod \"postgres-864846d4f5-h4bf9\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") " pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.186737 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.186693    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-postgresdata\") pod \"postgres-864846d4f5-h4bf9\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") " pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.186972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.186775    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gb4l\" (UniqueName: \"kubernetes.io/projected/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-kube-api-access-4gb4l\") pod \"postgres-864846d4f5-h4bf9\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") " pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.187140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.187118    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-postgresdata\") pod \"postgres-864846d4f5-h4bf9\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") " pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.198039 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.198007    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gb4l\" (UniqueName: \"kubernetes.io/projected/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-kube-api-access-4gb4l\") pod \"postgres-864846d4f5-h4bf9\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") " pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.328874 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.328770    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:33:18.469847 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.469821    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h4bf9"]
Jun 10 10:33:18.472252 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:33:18.472227    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eeefba0_4c6e_49d3_9646_6b2a71f4e402.slice/crio-fdc65a186cf21d0cf8c611a377583d79e86a619f986af1b1af420fc6e62391c5 WatchSource:0}: Error finding container fdc65a186cf21d0cf8c611a377583d79e86a619f986af1b1af420fc6e62391c5: Status 404 returned error can't find the container with id fdc65a186cf21d0cf8c611a377583d79e86a619f986af1b1af420fc6e62391c5
Jun 10 10:33:18.894363 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.894321    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9" event={"ID":"6eeefba0-4c6e-49d3-9646-6b2a71f4e402","Type":"ContainerStarted","Data":"5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae"}
Jun 10 10:33:18.894363 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.894368    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9" event={"ID":"6eeefba0-4c6e-49d3-9646-6b2a71f4e402","Type":"ContainerStarted","Data":"fdc65a186cf21d0cf8c611a377583d79e86a619f986af1b1af420fc6e62391c5"}
Jun 10 10:33:18.910613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:18.910557    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9" podStartSLOduration=1.910540224 podStartE2EDuration="1.910540224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:33:18.908943725 +0000 UTC m=+886.765880160" watchObservedRunningTime="2026-06-10 10:33:18.910540224 +0000 UTC m=+886.767476655"
Jun 10 10:33:23.829864 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.829828    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"]
Jun 10 10:33:23.833417 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.833392    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:23.838040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.838018    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 10 10:33:23.838275 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.838257    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 10 10:33:23.838354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.838287    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 10 10:33:23.840289 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.840269    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-gccf8\""
Jun 10 10:33:23.865188 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.865150    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"]
Jun 10 10:33:23.945090 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.945047    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-registry-tls\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:23.945282 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.945100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-online-tls\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:23.945282 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.945121    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwg4z\" (UniqueName: \"kubernetes.io/projected/17d3ec32-8a11-45cc-9463-2eb431e9c915-kube-api-access-nwg4z\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:23.945282 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:23.945204    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/17d3ec32-8a11-45cc-9463-2eb431e9c915-feast-data\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.045765 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.045724    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-registry-tls\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.045765 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.045774    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-online-tls\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.046037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.045794    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwg4z\" (UniqueName: \"kubernetes.io/projected/17d3ec32-8a11-45cc-9463-2eb431e9c915-kube-api-access-nwg4z\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.046037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.045821    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/17d3ec32-8a11-45cc-9463-2eb431e9c915-feast-data\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.046340 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.046321    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/17d3ec32-8a11-45cc-9463-2eb431e9c915-feast-data\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.048342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.048316    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-online-tls\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.048560 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.048539    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-registry-tls\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.056496 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.056471    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwg4z\" (UniqueName: \"kubernetes.io/projected/17d3ec32-8a11-45cc-9463-2eb431e9c915-kube-api-access-nwg4z\") pod \"feast-credit-scoring-77bcbb7949-ktkp6\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") " pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.143355 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.143307    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:24.296114 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.296084    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"]
Jun 10 10:33:24.296270 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:33:24.296249    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d3ec32_8a11_45cc_9463_2eb431e9c915.slice/crio-98b5bf8590324049ec0d56d11e9230cd27e5600944fffb644b18e780e067989e WatchSource:0}: Error finding container 98b5bf8590324049ec0d56d11e9230cd27e5600944fffb644b18e780e067989e: Status 404 returned error can't find the container with id 98b5bf8590324049ec0d56d11e9230cd27e5600944fffb644b18e780e067989e
Jun 10 10:33:24.921612 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.921569    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerStarted","Data":"76950331f63f52014e48007a69944f925399aeb6434cab4af04138789fee98cf"}
Jun 10 10:33:24.922044 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:24.921631    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerStarted","Data":"98b5bf8590324049ec0d56d11e9230cd27e5600944fffb644b18e780e067989e"}
Jun 10 10:33:25.450270 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:33:25.450238    2552 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d3ec32_8a11_45cc_9463_2eb431e9c915.slice/crio-76950331f63f52014e48007a69944f925399aeb6434cab4af04138789fee98cf.scope\": RecentStats: unable to find data in memory cache]"
Jun 10 10:33:25.927693 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:25.927661    2552 generic.go:356] "Generic (PLEG): container finished" podID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerID="76950331f63f52014e48007a69944f925399aeb6434cab4af04138789fee98cf" exitCode=0
Jun 10 10:33:25.928211 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:25.927721    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerDied","Data":"76950331f63f52014e48007a69944f925399aeb6434cab4af04138789fee98cf"}
Jun 10 10:33:26.933975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:26.933935    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerStarted","Data":"fd4b5231447442aae5912604a18356fca2930c6c5144d64d28979a49385bd966"}
Jun 10 10:33:33.965750 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:33.965715    2552 generic.go:356] "Generic (PLEG): container finished" podID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerID="fd4b5231447442aae5912604a18356fca2930c6c5144d64d28979a49385bd966" exitCode=0
Jun 10 10:33:33.966283 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:33.965764    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerDied","Data":"fd4b5231447442aae5912604a18356fca2930c6c5144d64d28979a49385bd966"}
Jun 10 10:33:33.969742 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:33.969722    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 10 10:33:34.974015 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:34.973972    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerStarted","Data":"87d29c13e873be51c708743ea29e1422c2c8ca9950bb46f273edb6da88878c05"}
Jun 10 10:33:34.974400 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:34.974048    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerStarted","Data":"5b9ce9d538cfb9e79edf9483a923193f996ed8ace339503ca597c13b80f10da0"}
Jun 10 10:33:35.001287 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:35.001221    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podStartSLOduration=12.001199208 podStartE2EDuration="12.001199208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:33:35.000075048 +0000 UTC m=+902.857011509" watchObservedRunningTime="2026-06-10 10:33:35.001199208 +0000 UTC m=+902.858135642"
Jun 10 10:33:36.143929 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:36.143875    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:36.144442 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:36.143971    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:36.145348 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:36.145316    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 10 10:33:36.145485 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:36.145374    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 10 10:33:39.143736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:39.143686    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 10 10:33:39.143736 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:39.143712    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 10 10:33:42.144623 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:42.144571    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 10 10:33:42.149980 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:42.149949    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:42.150519 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:42.150493    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:42.153315 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:42.153289    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:44.144182 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:44.144148    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:45.144430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:45.144380    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jun 10 10:33:48.144221 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:48.144189    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:48.144892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:48.144870    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:33:49.799347 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.799307    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"]
Jun 10 10:33:49.802445 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.802422    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.805369 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.805342    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 10 10:33:49.805531 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.805477    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 10 10:33:49.805747 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.805730    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 10 10:33:49.806038 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.806021    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-b6tm2\""
Jun 10 10:33:49.817191 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.817168    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"]
Jun 10 10:33:49.878979 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.878946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-registry-tls\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.879163 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.879015    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f95811f5-4818-486a-a2ba-44fc022f970a-feast-data\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.879163 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.879056    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxmmd\" (UniqueName: \"kubernetes.io/projected/f95811f5-4818-486a-a2ba-44fc022f970a-kube-api-access-qxmmd\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.879163 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.879093    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-online-tls\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.980544 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.980514    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-registry-tls\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.980737 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.980592    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f95811f5-4818-486a-a2ba-44fc022f970a-feast-data\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.980737 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.980631    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxmmd\" (UniqueName: \"kubernetes.io/projected/f95811f5-4818-486a-a2ba-44fc022f970a-kube-api-access-qxmmd\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.980737 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.980673    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-online-tls\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.981030 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.981010    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f95811f5-4818-486a-a2ba-44fc022f970a-feast-data\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.982945 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.982923    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-online-tls\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.983037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.982959    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-registry-tls\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:49.989224 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:49.989198    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxmmd\" (UniqueName: \"kubernetes.io/projected/f95811f5-4818-486a-a2ba-44fc022f970a-kube-api-access-qxmmd\") pod \"feast-driver-ranking-544b7b654b-2hl8d\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") " pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:50.112293 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:50.112253    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:33:50.247530 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:50.247495    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"]
Jun 10 10:33:50.249968 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:33:50.249943    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95811f5_4818_486a_a2ba_44fc022f970a.slice/crio-8efd07957b69f4ea94292d54184de5ef5e21de54ddc576d2cb694ac31267b2bd WatchSource:0}: Error finding container 8efd07957b69f4ea94292d54184de5ef5e21de54ddc576d2cb694ac31267b2bd: Status 404 returned error can't find the container with id 8efd07957b69f4ea94292d54184de5ef5e21de54ddc576d2cb694ac31267b2bd
Jun 10 10:33:51.060641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:51.060609    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerStarted","Data":"1173152f02726e1bc9f15e0ecfc8d50bd60a0fd9912f0d4c808d7a5a828f0eb0"}
Jun 10 10:33:51.061043 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:51.060662    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerStarted","Data":"8efd07957b69f4ea94292d54184de5ef5e21de54ddc576d2cb694ac31267b2bd"}
Jun 10 10:33:55.078237 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:55.078203    2552 generic.go:356] "Generic (PLEG): container finished" podID="f95811f5-4818-486a-a2ba-44fc022f970a" containerID="1173152f02726e1bc9f15e0ecfc8d50bd60a0fd9912f0d4c808d7a5a828f0eb0" exitCode=0
Jun 10 10:33:55.078649 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:55.078283    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerDied","Data":"1173152f02726e1bc9f15e0ecfc8d50bd60a0fd9912f0d4c808d7a5a828f0eb0"}
Jun 10 10:33:56.085319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:33:56.085285    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerStarted","Data":"56344c0c40100a6494ebd669da07edafa95e8f85833d03a9c0e8769eb763f290"}
Jun 10 10:34:03.118954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:03.118898    2552 generic.go:356] "Generic (PLEG): container finished" podID="f95811f5-4818-486a-a2ba-44fc022f970a" containerID="56344c0c40100a6494ebd669da07edafa95e8f85833d03a9c0e8769eb763f290" exitCode=0
Jun 10 10:34:03.118954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:03.118946    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerDied","Data":"56344c0c40100a6494ebd669da07edafa95e8f85833d03a9c0e8769eb763f290"}
Jun 10 10:34:04.125979 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:04.125946    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerStarted","Data":"fb404d03b24543d9580896b6925c7d1b12520579365b50e8df4258b589cdacbc"}
Jun 10 10:34:04.126364 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:04.125998    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerStarted","Data":"b34ed5475ba30affe6d0df9a2b34ce91ba9c1fc95f6bc3e21b23d84b42917a11"}
Jun 10 10:34:04.150231 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:04.150182    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podStartSLOduration=15.15016449 podStartE2EDuration="15.15016449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:34:04.148039052 +0000 UTC m=+932.004975488" watchObservedRunningTime="2026-06-10 10:34:04.15016449 +0000 UTC m=+932.007100924"
Jun 10 10:34:05.112818 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:05.112782    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:05.113045 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:05.112853    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:05.114585 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:05.114541    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 10 10:34:05.114717 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:05.114547    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 10 10:34:08.112765 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:08.112720    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 10 10:34:08.112765 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:08.112751    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 10 10:34:10.112667 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:10.112621    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:10.113203 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:10.112695    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:11.113011 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:11.112958    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 10 10:34:11.120309 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:11.120274    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:11.124508 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:11.124480    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:14.113242 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:14.113199    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Jun 10 10:34:17.113151 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:17.113110    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:34:17.113846 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:34:17.113826    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:35:35.433116 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:35.433080    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"]
Jun 10 10:35:35.433665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:35.433301    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry" containerID="cri-o://5b9ce9d538cfb9e79edf9483a923193f996ed8ace339503ca597c13b80f10da0" gracePeriod=30
Jun 10 10:35:35.433665 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:35.433347    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online" containerID="cri-o://87d29c13e873be51c708743ea29e1422c2c8ca9950bb46f273edb6da88878c05" gracePeriod=30
Jun 10 10:35:35.444995 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:35.444963    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"]
Jun 10 10:35:35.445183 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:35.445160    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry" containerID="cri-o://b34ed5475ba30affe6d0df9a2b34ce91ba9c1fc95f6bc3e21b23d84b42917a11" gracePeriod=30
Jun 10 10:35:35.445234 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:35.445189    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online" containerID="cri-o://fb404d03b24543d9580896b6925c7d1b12520579365b50e8df4258b589cdacbc" gracePeriod=30
Jun 10 10:35:36.544734 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:36.544647    2552 generic.go:356] "Generic (PLEG): container finished" podID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerID="87d29c13e873be51c708743ea29e1422c2c8ca9950bb46f273edb6da88878c05" exitCode=0
Jun 10 10:35:36.544734 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:36.544714    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerDied","Data":"87d29c13e873be51c708743ea29e1422c2c8ca9950bb46f273edb6da88878c05"}
Jun 10 10:35:36.546850 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:36.546831    2552 generic.go:356] "Generic (PLEG): container finished" podID="f95811f5-4818-486a-a2ba-44fc022f970a" containerID="fb404d03b24543d9580896b6925c7d1b12520579365b50e8df4258b589cdacbc" exitCode=0
Jun 10 10:35:36.546982 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:36.546900    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerDied","Data":"fb404d03b24543d9580896b6925c7d1b12520579365b50e8df4258b589cdacbc"}
Jun 10 10:35:37.458373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.458333    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h4bf9"]
Jun 10 10:35:37.458603 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.458576    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9" podUID="6eeefba0-4c6e-49d3-9646-6b2a71f4e402" containerName="postgres" containerID="cri-o://5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae" gracePeriod=30
Jun 10 10:35:37.469393 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.469364    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tzzmr"]
Jun 10 10:35:37.469584 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.469543    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr" podUID="f423d842-f546-4d10-b655-31cb3a6bd4af" containerName="redis" containerID="cri-o://58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382" gracePeriod=30
Jun 10 10:35:37.733352 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.733329    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:35:37.736110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.736088    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:35:37.763229 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.763205    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gb4l\" (UniqueName: \"kubernetes.io/projected/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-kube-api-access-4gb4l\") pod \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") "
Jun 10 10:35:37.763354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.763281    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p76bj\" (UniqueName: \"kubernetes.io/projected/f423d842-f546-4d10-b655-31cb3a6bd4af-kube-api-access-p76bj\") pod \"f423d842-f546-4d10-b655-31cb3a6bd4af\" (UID: \"f423d842-f546-4d10-b655-31cb3a6bd4af\") "
Jun 10 10:35:37.763354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.763310    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-postgresdata\") pod \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\" (UID: \"6eeefba0-4c6e-49d3-9646-6b2a71f4e402\") "
Jun 10 10:35:37.765466 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.765438    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-kube-api-access-4gb4l" (OuterVolumeSpecName: "kube-api-access-4gb4l") pod "6eeefba0-4c6e-49d3-9646-6b2a71f4e402" (UID: "6eeefba0-4c6e-49d3-9646-6b2a71f4e402"). InnerVolumeSpecName "kube-api-access-4gb4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:35:37.765619 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.765500    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f423d842-f546-4d10-b655-31cb3a6bd4af-kube-api-access-p76bj" (OuterVolumeSpecName: "kube-api-access-p76bj") pod "f423d842-f546-4d10-b655-31cb3a6bd4af" (UID: "f423d842-f546-4d10-b655-31cb3a6bd4af"). InnerVolumeSpecName "kube-api-access-p76bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:35:37.803543 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.803498    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "6eeefba0-4c6e-49d3-9646-6b2a71f4e402" (UID: "6eeefba0-4c6e-49d3-9646-6b2a71f4e402"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:35:37.864691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.864657    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p76bj\" (UniqueName: \"kubernetes.io/projected/f423d842-f546-4d10-b655-31cb3a6bd4af-kube-api-access-p76bj\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:35:37.864691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.864685    2552 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-postgresdata\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:35:37.864691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:37.864695    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gb4l\" (UniqueName: \"kubernetes.io/projected/6eeefba0-4c6e-49d3-9646-6b2a71f4e402-kube-api-access-4gb4l\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:35:38.556835 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.556796    2552 generic.go:356] "Generic (PLEG): container finished" podID="f423d842-f546-4d10-b655-31cb3a6bd4af" containerID="58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382" exitCode=0
Jun 10 10:35:38.557067 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.556842    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr"
Jun 10 10:35:38.557067 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.556887    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr" event={"ID":"f423d842-f546-4d10-b655-31cb3a6bd4af","Type":"ContainerDied","Data":"58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382"}
Jun 10 10:35:38.557067 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.556956    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tzzmr" event={"ID":"f423d842-f546-4d10-b655-31cb3a6bd4af","Type":"ContainerDied","Data":"7dfc55f6b731667a5b283755f4f517af23019afb714f89cfccfce10fbe209f01"}
Jun 10 10:35:38.557067 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.556979    2552 scope.go:117] "RemoveContainer" containerID="58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382"
Jun 10 10:35:38.558379 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.558177    2552 generic.go:356] "Generic (PLEG): container finished" podID="6eeefba0-4c6e-49d3-9646-6b2a71f4e402" containerID="5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae" exitCode=0
Jun 10 10:35:38.558379 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.558216    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9"
Jun 10 10:35:38.558379 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.558264    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9" event={"ID":"6eeefba0-4c6e-49d3-9646-6b2a71f4e402","Type":"ContainerDied","Data":"5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae"}
Jun 10 10:35:38.558379 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.558298    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h4bf9" event={"ID":"6eeefba0-4c6e-49d3-9646-6b2a71f4e402","Type":"ContainerDied","Data":"fdc65a186cf21d0cf8c611a377583d79e86a619f986af1b1af420fc6e62391c5"}
Jun 10 10:35:38.566272 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.566257    2552 scope.go:117] "RemoveContainer" containerID="58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382"
Jun 10 10:35:38.566654 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:35:38.566621    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382\": container with ID starting with 58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382 not found: ID does not exist" containerID="58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382"
Jun 10 10:35:38.566757 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.566666    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382"} err="failed to get container status \"58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382\": rpc error: code = NotFound desc = could not find container \"58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382\": container with ID starting with 58c33de5eceaad24e552b49162685ee152f01058f3e2adc100e8a7f7298c8382 not found: ID does not exist"
Jun 10 10:35:38.566757 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.566689    2552 scope.go:117] "RemoveContainer" containerID="5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae"
Jun 10 10:35:38.575319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.575300    2552 scope.go:117] "RemoveContainer" containerID="5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae"
Jun 10 10:35:38.575607 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:35:38.575589    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae\": container with ID starting with 5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae not found: ID does not exist" containerID="5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae"
Jun 10 10:35:38.575669 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.575620    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae"} err="failed to get container status \"5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae\": rpc error: code = NotFound desc = could not find container \"5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae\": container with ID starting with 5c947a5d6a6bd8ba4dd23d4800e0dcbe8e6d59701fa4c56885e8ba75715828ae not found: ID does not exist"
Jun 10 10:35:38.584143 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.584116    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tzzmr"]
Jun 10 10:35:38.590578 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.590557    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tzzmr"]
Jun 10 10:35:38.604569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.604538    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h4bf9"]
Jun 10 10:35:38.609402 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:38.609377    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h4bf9"]
Jun 10 10:35:40.578961 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:40.578927    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eeefba0-4c6e-49d3-9646-6b2a71f4e402" path="/var/lib/kubelet/pods/6eeefba0-4c6e-49d3-9646-6b2a71f4e402/volumes"
Jun 10 10:35:40.579337 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:40.579269    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f423d842-f546-4d10-b655-31cb3a6bd4af" path="/var/lib/kubelet/pods/f423d842-f546-4d10-b655-31cb3a6bd4af/volumes"
Jun 10 10:35:41.121350 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:41.121312    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 10 10:35:42.151619 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:42.151571    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 10 10:35:51.121130 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:51.121088    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 10 10:35:52.151073 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:35:52.151032    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 10 10:36:01.121473 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:01.121430    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Jun 10 10:36:01.121975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:01.121561    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:36:02.150842 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:02.150796    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jun 10 10:36:02.151249 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:02.150935    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:36:05.678042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:05.678007    2552 generic.go:356] "Generic (PLEG): container finished" podID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerID="5b9ce9d538cfb9e79edf9483a923193f996ed8ace339503ca597c13b80f10da0" exitCode=137
Jun 10 10:36:05.678506 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:05.678070    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerDied","Data":"5b9ce9d538cfb9e79edf9483a923193f996ed8ace339503ca597c13b80f10da0"}
Jun 10 10:36:05.680421 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:05.680396    2552 generic.go:356] "Generic (PLEG): container finished" podID="f95811f5-4818-486a-a2ba-44fc022f970a" containerID="b34ed5475ba30affe6d0df9a2b34ce91ba9c1fc95f6bc3e21b23d84b42917a11" exitCode=137
Jun 10 10:36:05.680531 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:05.680464    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerDied","Data":"b34ed5475ba30affe6d0df9a2b34ce91ba9c1fc95f6bc3e21b23d84b42917a11"}
Jun 10 10:36:06.086243 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.086214    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:36:06.107454 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.107430    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:36:06.212350 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212263    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-registry-tls\") pod \"17d3ec32-8a11-45cc-9463-2eb431e9c915\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") "
Jun 10 10:36:06.212350 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212326    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxmmd\" (UniqueName: \"kubernetes.io/projected/f95811f5-4818-486a-a2ba-44fc022f970a-kube-api-access-qxmmd\") pod \"f95811f5-4818-486a-a2ba-44fc022f970a\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") "
Jun 10 10:36:06.212576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212359    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwg4z\" (UniqueName: \"kubernetes.io/projected/17d3ec32-8a11-45cc-9463-2eb431e9c915-kube-api-access-nwg4z\") pod \"17d3ec32-8a11-45cc-9463-2eb431e9c915\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") "
Jun 10 10:36:06.212576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212374    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-registry-tls\") pod \"f95811f5-4818-486a-a2ba-44fc022f970a\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") "
Jun 10 10:36:06.212576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212396    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f95811f5-4818-486a-a2ba-44fc022f970a-feast-data\") pod \"f95811f5-4818-486a-a2ba-44fc022f970a\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") "
Jun 10 10:36:06.212576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212420    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/17d3ec32-8a11-45cc-9463-2eb431e9c915-feast-data\") pod \"17d3ec32-8a11-45cc-9463-2eb431e9c915\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") "
Jun 10 10:36:06.212576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212460    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-online-tls\") pod \"f95811f5-4818-486a-a2ba-44fc022f970a\" (UID: \"f95811f5-4818-486a-a2ba-44fc022f970a\") "
Jun 10 10:36:06.212576 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212508    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-online-tls\") pod \"17d3ec32-8a11-45cc-9463-2eb431e9c915\" (UID: \"17d3ec32-8a11-45cc-9463-2eb431e9c915\") "
Jun 10 10:36:06.213227 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.212958    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f95811f5-4818-486a-a2ba-44fc022f970a-feast-data" (OuterVolumeSpecName: "feast-data") pod "f95811f5-4818-486a-a2ba-44fc022f970a" (UID: "f95811f5-4818-486a-a2ba-44fc022f970a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:36:06.214724 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.214687    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-online-tls" (OuterVolumeSpecName: "online-tls") pod "17d3ec32-8a11-45cc-9463-2eb431e9c915" (UID: "17d3ec32-8a11-45cc-9463-2eb431e9c915"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:36:06.215076 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.215051    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "17d3ec32-8a11-45cc-9463-2eb431e9c915" (UID: "17d3ec32-8a11-45cc-9463-2eb431e9c915"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:36:06.215172 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.215074    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f95811f5-4818-486a-a2ba-44fc022f970a" (UID: "f95811f5-4818-486a-a2ba-44fc022f970a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:36:06.215172 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.215139    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d3ec32-8a11-45cc-9463-2eb431e9c915-kube-api-access-nwg4z" (OuterVolumeSpecName: "kube-api-access-nwg4z") pod "17d3ec32-8a11-45cc-9463-2eb431e9c915" (UID: "17d3ec32-8a11-45cc-9463-2eb431e9c915"). InnerVolumeSpecName "kube-api-access-nwg4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:36:06.215172 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.215167    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95811f5-4818-486a-a2ba-44fc022f970a-kube-api-access-qxmmd" (OuterVolumeSpecName: "kube-api-access-qxmmd") pod "f95811f5-4818-486a-a2ba-44fc022f970a" (UID: "f95811f5-4818-486a-a2ba-44fc022f970a"). InnerVolumeSpecName "kube-api-access-qxmmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:36:06.215288 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.215226    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-online-tls" (OuterVolumeSpecName: "online-tls") pod "f95811f5-4818-486a-a2ba-44fc022f970a" (UID: "f95811f5-4818-486a-a2ba-44fc022f970a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:36:06.222491 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.222467    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17d3ec32-8a11-45cc-9463-2eb431e9c915-feast-data" (OuterVolumeSpecName: "feast-data") pod "17d3ec32-8a11-45cc-9463-2eb431e9c915" (UID: "17d3ec32-8a11-45cc-9463-2eb431e9c915"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:36:06.314042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314006    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314038    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxmmd\" (UniqueName: \"kubernetes.io/projected/f95811f5-4818-486a-a2ba-44fc022f970a-kube-api-access-qxmmd\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314047    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwg4z\" (UniqueName: \"kubernetes.io/projected/17d3ec32-8a11-45cc-9463-2eb431e9c915-kube-api-access-nwg4z\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314056    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314067    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f95811f5-4818-486a-a2ba-44fc022f970a-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314075    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/17d3ec32-8a11-45cc-9463-2eb431e9c915-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314083    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f95811f5-4818-486a-a2ba-44fc022f970a-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.314295 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.314091    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/17d3ec32-8a11-45cc-9463-2eb431e9c915-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:36:06.687330 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.687293    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6" event={"ID":"17d3ec32-8a11-45cc-9463-2eb431e9c915","Type":"ContainerDied","Data":"98b5bf8590324049ec0d56d11e9230cd27e5600944fffb644b18e780e067989e"}
Jun 10 10:36:06.687859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.687307    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"
Jun 10 10:36:06.687859 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.687391    2552 scope.go:117] "RemoveContainer" containerID="87d29c13e873be51c708743ea29e1422c2c8ca9950bb46f273edb6da88878c05"
Jun 10 10:36:06.689941 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.689892    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d" event={"ID":"f95811f5-4818-486a-a2ba-44fc022f970a","Type":"ContainerDied","Data":"8efd07957b69f4ea94292d54184de5ef5e21de54ddc576d2cb694ac31267b2bd"}
Jun 10 10:36:06.690129 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.690005    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"
Jun 10 10:36:06.696654 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.696638    2552 scope.go:117] "RemoveContainer" containerID="5b9ce9d538cfb9e79edf9483a923193f996ed8ace339503ca597c13b80f10da0"
Jun 10 10:36:06.704602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.704582    2552 scope.go:117] "RemoveContainer" containerID="fd4b5231447442aae5912604a18356fca2930c6c5144d64d28979a49385bd966"
Jun 10 10:36:06.707801 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.707772    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"]
Jun 10 10:36:06.712215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.712200    2552 scope.go:117] "RemoveContainer" containerID="76950331f63f52014e48007a69944f925399aeb6434cab4af04138789fee98cf"
Jun 10 10:36:06.714164 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.714146    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-77bcbb7949-ktkp6"]
Jun 10 10:36:06.719567 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.719547    2552 scope.go:117] "RemoveContainer" containerID="fb404d03b24543d9580896b6925c7d1b12520579365b50e8df4258b589cdacbc"
Jun 10 10:36:06.726305 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.726285    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"]
Jun 10 10:36:06.727216 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.727202    2552 scope.go:117] "RemoveContainer" containerID="b34ed5475ba30affe6d0df9a2b34ce91ba9c1fc95f6bc3e21b23d84b42917a11"
Jun 10 10:36:06.731008 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.730985    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-544b7b654b-2hl8d"]
Jun 10 10:36:06.735797 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.735782    2552 scope.go:117] "RemoveContainer" containerID="56344c0c40100a6494ebd669da07edafa95e8f85833d03a9c0e8769eb763f290"
Jun 10 10:36:06.742976 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:06.742930    2552 scope.go:117] "RemoveContainer" containerID="1173152f02726e1bc9f15e0ecfc8d50bd60a0fd9912f0d4c808d7a5a828f0eb0"
Jun 10 10:36:08.579489 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:08.579456    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" path="/var/lib/kubelet/pods/17d3ec32-8a11-45cc-9463-2eb431e9c915/volumes"
Jun 10 10:36:08.579979 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:08.579965    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" path="/var/lib/kubelet/pods/f95811f5-4818-486a-a2ba-44fc022f970a/volumes"
Jun 10 10:36:13.724469 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724435    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"]
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724754    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724765    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724775    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f423d842-f546-4d10-b655-31cb3a6bd4af" containerName="redis"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724781    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f423d842-f546-4d10-b655-31cb3a6bd4af" containerName="redis"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724787    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724794    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724803    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724808    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724813    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="feast-apply"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724819    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="feast-apply"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724825    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724830    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724834    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="feast-apply"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724839    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="feast-apply"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724849    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eeefba0-4c6e-49d3-9646-6b2a71f4e402" containerName="postgres"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724854    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eeefba0-4c6e-49d3-9646-6b2a71f4e402" containerName="postgres"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724860    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="feast-init"
Jun 10 10:36:13.724855 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724865    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="feast-init"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724871    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="feast-init"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724876    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="feast-init"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724960    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f423d842-f546-4d10-b655-31cb3a6bd4af" containerName="redis"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724971    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="registry"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724981    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eeefba0-4c6e-49d3-9646-6b2a71f4e402" containerName="postgres"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724988    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="registry"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.724996    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d3ec32-8a11-45cc-9463-2eb431e9c915" containerName="online"
Jun 10 10:36:13.725430 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.725002    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f95811f5-4818-486a-a2ba-44fc022f970a" containerName="online"
Jun 10 10:36:13.730319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.730300    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.736963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.736790    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 10 10:36:13.736963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.736800    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 10 10:36:13.737113 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.737062    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 10 10:36:13.737113 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.737074    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 10 10:36:13.737222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.737114    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-h2zrv\""
Jun 10 10:36:13.737222 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.737169    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 10 10:36:13.737777 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.737761    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 10 10:36:13.759563 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.759532    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"]
Jun 10 10:36:13.879245 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.879208    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.879427 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.879268    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.879427 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.879346    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.879427 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.879403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c876ba5-854e-4014-9804-5ffecf1fdf18-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.879538 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.879441    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.879538 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.879465    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz8g9\" (UniqueName: \"kubernetes.io/projected/0c876ba5-854e-4014-9804-5ffecf1fdf18-kube-api-access-sz8g9\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.980980 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.980862    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.980980 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.980915    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.980980 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.980947    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c876ba5-854e-4014-9804-5ffecf1fdf18-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.980980 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.980975    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.981320 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.980994    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz8g9\" (UniqueName: \"kubernetes.io/projected/0c876ba5-854e-4014-9804-5ffecf1fdf18-kube-api-access-sz8g9\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.981320 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.981019    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.981428 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.981374    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c876ba5-854e-4014-9804-5ffecf1fdf18-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.983703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.983674    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.983703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.983689    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.983703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.983698    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:13.983888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:13.983692    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:14.003274 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:14.003250    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz8g9\" (UniqueName: \"kubernetes.io/projected/0c876ba5-854e-4014-9804-5ffecf1fdf18-kube-api-access-sz8g9\") pod \"feast-simple-feast-setup-75c64c888b-gm4nq\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:14.053251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:14.053212    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:14.192880 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:14.192856    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"]
Jun 10 10:36:14.195532 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:36:14.195503    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c876ba5_854e_4014_9804_5ffecf1fdf18.slice/crio-15699a0b4e61e5f784c27c925e42df1c22b4552288489a30a3f7a108ad173afb WatchSource:0}: Error finding container 15699a0b4e61e5f784c27c925e42df1c22b4552288489a30a3f7a108ad173afb: Status 404 returned error can't find the container with id 15699a0b4e61e5f784c27c925e42df1c22b4552288489a30a3f7a108ad173afb
Jun 10 10:36:14.197289 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:14.197274    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 10:36:14.725425 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:14.725392    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"15699a0b4e61e5f784c27c925e42df1c22b4552288489a30a3f7a108ad173afb"}
Jun 10 10:36:30.810077 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:30.810030    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"0a52d3e7bd4468e361f8f6ac264bc9623608cd42c8d90f60304f6726a20e77ba"}
Jun 10 10:36:35.832691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:35.832650    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerID="0a52d3e7bd4468e361f8f6ac264bc9623608cd42c8d90f60304f6726a20e77ba" exitCode=0
Jun 10 10:36:35.833155 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:35.832722    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"0a52d3e7bd4468e361f8f6ac264bc9623608cd42c8d90f60304f6726a20e77ba"}
Jun 10 10:36:36.839258 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:36.839216    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"ef0233e389db8e011bb5d818952bd92752e3234c11dd5e8a2198dd0243c8ba85"}
Jun 10 10:36:41.860861 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:41.860832    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerID="ef0233e389db8e011bb5d818952bd92752e3234c11dd5e8a2198dd0243c8ba85" exitCode=0
Jun 10 10:36:41.861254 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:41.860921    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"ef0233e389db8e011bb5d818952bd92752e3234c11dd5e8a2198dd0243c8ba85"}
Jun 10 10:36:42.871991 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:42.871948    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"3045967c4e15130334d005b65e1669ce3e9dd7889b49d8c031b12dc13b570603"}
Jun 10 10:36:42.872495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:42.872015    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"24677f9c603cc19f6feb7fa054125ba6b420722487cc02a423ec6177c11a7270"}
Jun 10 10:36:42.872495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:42.872041    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"4f453c598cf7b7eef83e005ada98f6758f6a3b6122f8d173fd9de284398aaff2"}
Jun 10 10:36:42.872495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:42.872059    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerStarted","Data":"824a9a4e65d70cacc1ac4280bea8ba6623004185bd472215bbfb12041cc1bf64"}
Jun 10 10:36:42.898548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:42.898474    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podStartSLOduration=13.908724601 podStartE2EDuration="29.898452052s" totalImagesPullingTime="15.989727451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:36:42.896926822 +0000 UTC m=+1090.753863250" watchObservedRunningTime="2026-06-10 10:36:42.898452052 +0000 UTC m=+1090.755388483"
Jun 10 10:36:44.053699 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.053658    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054332 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054312    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054451 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054440    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054554 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054544    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054643 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054633    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054734 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054725    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054830 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054820    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.054955 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.054943    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:44.056050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.056020    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Jun 10 10:36:44.056300 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.056024    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jun 10 10:36:44.056382 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.056063    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.32:8816: connect: connection refused"
Jun 10 10:36:44.056382 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:44.056113    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jun 10 10:36:47.054579 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:47.054516    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jun 10 10:36:47.055120 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:47.054578    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jun 10 10:36:47.055120 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:47.054532    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.32:8816: connect: connection refused"
Jun 10 10:36:47.055120 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:47.054606    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Jun 10 10:36:50.055184 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.055155    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.055637 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.055327    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.055710 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.055675    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.056121 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.056084    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.056265 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.056156    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.056265 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.056241    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.060251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.060225    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:36:50.916834 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:36:50.916804    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:37:52.199065 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.198986    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"]
Jun 10 10:37:52.199892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.199220    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="registry" containerID="cri-o://824a9a4e65d70cacc1ac4280bea8ba6623004185bd472215bbfb12041cc1bf64" gracePeriod=30
Jun 10 10:37:52.199892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.199234    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui" containerID="cri-o://3045967c4e15130334d005b65e1669ce3e9dd7889b49d8c031b12dc13b570603" gracePeriod=30
Jun 10 10:37:52.199892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.199294    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="offline" containerID="cri-o://24677f9c603cc19f6feb7fa054125ba6b420722487cc02a423ec6177c11a7270" gracePeriod=30
Jun 10 10:37:52.199892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.199325    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online" containerID="cri-o://4f453c598cf7b7eef83e005ada98f6758f6a3b6122f8d173fd9de284398aaff2" gracePeriod=30
Jun 10 10:37:52.510398 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.510309    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"]
Jun 10 10:37:52.513209 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.513186    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.515698 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.515678    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-q6znz\""
Jun 10 10:37:52.525776 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.525744    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"]
Jun 10 10:37:52.661559 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.661510    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe5ab36-3dc0-4715-93e5-12892548fc56-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.661732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.661633    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.661732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.661687    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwqk2\" (UniqueName: \"kubernetes.io/projected/3fe5ab36-3dc0-4715-93e5-12892548fc56-kube-api-access-dwqk2\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.661813 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.661749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.661848 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.661820    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.661882 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.661849    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763020 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.762946    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe5ab36-3dc0-4715-93e5-12892548fc56-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763020 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.763006    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763174 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.763034    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwqk2\" (UniqueName: \"kubernetes.io/projected/3fe5ab36-3dc0-4715-93e5-12892548fc56-kube-api-access-dwqk2\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763174 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.763055    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763174 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.763078    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763174 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.763093    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763301 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:37:52.763218    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 10 10:37:52.763301 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:37:52.763276    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls podName:3fe5ab36-3dc0-4715-93e5-12892548fc56 nodeName:}" failed. No retries permitted until 2026-06-10 10:37:53.263260334 +0000 UTC m=+1161.120196742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls") pod "feast-simple-feast-setup-75c64c888b-wm85g" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56") : secret "feast-simple-feast-setup-online-tls" not found
Jun 10 10:37:52.763386 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.763365    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe5ab36-3dc0-4715-93e5-12892548fc56-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.763478 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:37:52.763465    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:37:52.763525 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:37:52.763516    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls podName:3fe5ab36-3dc0-4715-93e5-12892548fc56 nodeName:}" failed. No retries permitted until 2026-06-10 10:37:53.263499666 +0000 UTC m=+1161.120436077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls") pod "feast-simple-feast-setup-75c64c888b-wm85g" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:37:52.765832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.765801    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.765964 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.765891    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:52.772315 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:52.772292    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwqk2\" (UniqueName: \"kubernetes.io/projected/3fe5ab36-3dc0-4715-93e5-12892548fc56-kube-api-access-dwqk2\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:53.177641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.177604    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerID="3045967c4e15130334d005b65e1669ce3e9dd7889b49d8c031b12dc13b570603" exitCode=0
Jun 10 10:37:53.177641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.177634    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerID="4f453c598cf7b7eef83e005ada98f6758f6a3b6122f8d173fd9de284398aaff2" exitCode=0
Jun 10 10:37:53.177850 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.177680    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"3045967c4e15130334d005b65e1669ce3e9dd7889b49d8c031b12dc13b570603"}
Jun 10 10:37:53.177850 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.177723    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"4f453c598cf7b7eef83e005ada98f6758f6a3b6122f8d173fd9de284398aaff2"}
Jun 10 10:37:53.269277 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.269189    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:53.269277 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.269237    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:53.269674 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:37:53.269353    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 10 10:37:53.269674 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:37:53.269424    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls podName:3fe5ab36-3dc0-4715-93e5-12892548fc56 nodeName:}" failed. No retries permitted until 2026-06-10 10:37:54.269407639 +0000 UTC m=+1162.126344062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls") pod "feast-simple-feast-setup-75c64c888b-wm85g" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56") : secret "feast-simple-feast-setup-online-tls" not found
Jun 10 10:37:53.271602 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:53.271579    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:54.278999 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:54.278958    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:54.281484 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:54.281457    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wm85g\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:54.327510 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:54.327469    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:37:54.464352 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:54.464329    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"]
Jun 10 10:37:54.465549 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:37:54.465521    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fe5ab36_3dc0_4715_93e5_12892548fc56.slice/crio-79e74a4b4a747119a01fadb5f64d3089a02a40873330c470381e48e64880d1db WatchSource:0}: Error finding container 79e74a4b4a747119a01fadb5f64d3089a02a40873330c470381e48e64880d1db: Status 404 returned error can't find the container with id 79e74a4b4a747119a01fadb5f64d3089a02a40873330c470381e48e64880d1db
Jun 10 10:37:55.187652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:55.187617    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"28a18400d052b90bfb1a3b5231acdcd1a4a44fe5ab3150cbed38f6b624b1c0ec"}
Jun 10 10:37:55.187812 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:55.187664    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"79e74a4b4a747119a01fadb5f64d3089a02a40873330c470381e48e64880d1db"}
Jun 10 10:37:59.207153 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:59.207117    2552 generic.go:356] "Generic (PLEG): container finished" podID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerID="28a18400d052b90bfb1a3b5231acdcd1a4a44fe5ab3150cbed38f6b624b1c0ec" exitCode=0
Jun 10 10:37:59.207644 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:37:59.207192    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"28a18400d052b90bfb1a3b5231acdcd1a4a44fe5ab3150cbed38f6b624b1c0ec"}
Jun 10 10:38:00.055901 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:00.055858    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jun 10 10:38:00.213645 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:00.213603    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"1aa0b67e7102b6350a7a1abe6f4de881b7e838f15d6c675fa75665eef09fbcc6"}
Jun 10 10:38:00.914748 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:00.914707    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jun 10 10:38:05.237360 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:05.237323    2552 generic.go:356] "Generic (PLEG): container finished" podID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerID="1aa0b67e7102b6350a7a1abe6f4de881b7e838f15d6c675fa75665eef09fbcc6" exitCode=0
Jun 10 10:38:05.237758 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:05.237397    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"1aa0b67e7102b6350a7a1abe6f4de881b7e838f15d6c675fa75665eef09fbcc6"}
Jun 10 10:38:06.248732 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.248681    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"d2b53a7cf75a0d206cad7563d48b5a0d8a9a68d2fda765271a23571c94320d5f"}
Jun 10 10:38:06.249271 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.248753    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"5b40b07d533450f41ee0fbcfcc3fe7db631303bf5d7f8f4692d554694a8a1542"}
Jun 10 10:38:06.249271 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.248778    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"9acfce5ef249f8999920bc379e2be9561ed59fa9a34fb5fc3688eafbe4b4217d"}
Jun 10 10:38:06.249271 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.248799    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerStarted","Data":"8112076a1c1c30c2b0438aef67f927197f6273ad7a24fa7d26ae3423ba7f5062"}
Jun 10 10:38:06.277704 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.277635    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podStartSLOduration=14.277615718 podStartE2EDuration="14.277615718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:37:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:38:06.274580295 +0000 UTC m=+1174.131516727" watchObservedRunningTime="2026-06-10 10:38:06.277615718 +0000 UTC m=+1174.134552155"
Jun 10 10:38:06.328425 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.328361    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:06.328746 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.328710    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:06.328965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.328950    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:06.329110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.329097    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:06.330673 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.330637    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
Jun 10 10:38:06.330892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.330682    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
Jun 10 10:38:06.331022 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.330699    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jun 10 10:38:06.331022 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:06.330734    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jun 10 10:38:09.328417 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:09.328354    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
Jun 10 10:38:09.328417 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:09.328412    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
Jun 10 10:38:09.328993 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:09.328358    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jun 10 10:38:09.328993 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:09.328456    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jun 10 10:38:10.056622 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:10.056505    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jun 10 10:38:10.914809 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:10.914759    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jun 10 10:38:12.328712 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.328679    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.329190 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.328836    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.329265 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.329185    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.329605 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.329570    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.329745 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.329616    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.329745 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.329674    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.329745 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.329724    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:12.333329 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:12.333308    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:13.287721 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:13.287690    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:13.287937 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:13.287732    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:13.288312 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:13.288292    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:13.290540 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:13.290520    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:38:20.055990 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:20.055941    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jun 10 10:38:20.056453 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:20.056095    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:38:20.914512 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:20.914464    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jun 10 10:38:20.914694 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:20.914618    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:38:22.327753 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.327721    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerID="24677f9c603cc19f6feb7fa054125ba6b420722487cc02a423ec6177c11a7270" exitCode=137
Jun 10 10:38:22.327753 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.327745    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerID="824a9a4e65d70cacc1ac4280bea8ba6623004185bd472215bbfb12041cc1bf64" exitCode=137
Jun 10 10:38:22.328226 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.327776    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"24677f9c603cc19f6feb7fa054125ba6b420722487cc02a423ec6177c11a7270"}
Jun 10 10:38:22.328226 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.327808    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"824a9a4e65d70cacc1ac4280bea8ba6623004185bd472215bbfb12041cc1bf64"}
Jun 10 10:38:22.850179 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.850155    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:38:22.947759 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.947724    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-registry-tls\") pod \"0c876ba5-854e-4014-9804-5ffecf1fdf18\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") "
Jun 10 10:38:22.947943 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.947774    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c876ba5-854e-4014-9804-5ffecf1fdf18-feast-data\") pod \"0c876ba5-854e-4014-9804-5ffecf1fdf18\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") "
Jun 10 10:38:22.947943 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.947815    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-ui-tls\") pod \"0c876ba5-854e-4014-9804-5ffecf1fdf18\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") "
Jun 10 10:38:22.947943 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.947844    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-online-tls\") pod \"0c876ba5-854e-4014-9804-5ffecf1fdf18\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") "
Jun 10 10:38:22.947943 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.947879    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-offline-tls\") pod \"0c876ba5-854e-4014-9804-5ffecf1fdf18\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") "
Jun 10 10:38:22.948204 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.948024    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz8g9\" (UniqueName: \"kubernetes.io/projected/0c876ba5-854e-4014-9804-5ffecf1fdf18-kube-api-access-sz8g9\") pod \"0c876ba5-854e-4014-9804-5ffecf1fdf18\" (UID: \"0c876ba5-854e-4014-9804-5ffecf1fdf18\") "
Jun 10 10:38:22.948357 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.948328    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c876ba5-854e-4014-9804-5ffecf1fdf18-feast-data" (OuterVolumeSpecName: "feast-data") pod "0c876ba5-854e-4014-9804-5ffecf1fdf18" (UID: "0c876ba5-854e-4014-9804-5ffecf1fdf18"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:38:22.950271 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.950237    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0c876ba5-854e-4014-9804-5ffecf1fdf18" (UID: "0c876ba5-854e-4014-9804-5ffecf1fdf18"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:38:22.950271 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.950255    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-online-tls" (OuterVolumeSpecName: "online-tls") pod "0c876ba5-854e-4014-9804-5ffecf1fdf18" (UID: "0c876ba5-854e-4014-9804-5ffecf1fdf18"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:38:22.950461 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.950254    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c876ba5-854e-4014-9804-5ffecf1fdf18-kube-api-access-sz8g9" (OuterVolumeSpecName: "kube-api-access-sz8g9") pod "0c876ba5-854e-4014-9804-5ffecf1fdf18" (UID: "0c876ba5-854e-4014-9804-5ffecf1fdf18"). InnerVolumeSpecName "kube-api-access-sz8g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:38:22.950461 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.950393    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0c876ba5-854e-4014-9804-5ffecf1fdf18" (UID: "0c876ba5-854e-4014-9804-5ffecf1fdf18"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:38:22.950461 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:22.950405    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0c876ba5-854e-4014-9804-5ffecf1fdf18" (UID: "0c876ba5-854e-4014-9804-5ffecf1fdf18"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:38:23.049162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.049045    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:38:23.049162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.049095    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:38:23.049162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.049108    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:38:23.049162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.049121    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz8g9\" (UniqueName: \"kubernetes.io/projected/0c876ba5-854e-4014-9804-5ffecf1fdf18-kube-api-access-sz8g9\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:38:23.049162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.049132    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0c876ba5-854e-4014-9804-5ffecf1fdf18-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:38:23.049162 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.049146    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c876ba5-854e-4014-9804-5ffecf1fdf18-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:38:23.334319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.334227    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq" event={"ID":"0c876ba5-854e-4014-9804-5ffecf1fdf18","Type":"ContainerDied","Data":"15699a0b4e61e5f784c27c925e42df1c22b4552288489a30a3f7a108ad173afb"}
Jun 10 10:38:23.334319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.334256    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"
Jun 10 10:38:23.334319 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.334277    2552 scope.go:117] "RemoveContainer" containerID="3045967c4e15130334d005b65e1669ce3e9dd7889b49d8c031b12dc13b570603"
Jun 10 10:38:23.344280 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.344257    2552 scope.go:117] "RemoveContainer" containerID="24677f9c603cc19f6feb7fa054125ba6b420722487cc02a423ec6177c11a7270"
Jun 10 10:38:23.352690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.352668    2552 scope.go:117] "RemoveContainer" containerID="4f453c598cf7b7eef83e005ada98f6758f6a3b6122f8d173fd9de284398aaff2"
Jun 10 10:38:23.359077 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.359050    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"]
Jun 10 10:38:23.361772 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.361748    2552 scope.go:117] "RemoveContainer" containerID="824a9a4e65d70cacc1ac4280bea8ba6623004185bd472215bbfb12041cc1bf64"
Jun 10 10:38:23.363542 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.363521    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gm4nq"]
Jun 10 10:38:23.369787 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.369771    2552 scope.go:117] "RemoveContainer" containerID="ef0233e389db8e011bb5d818952bd92752e3234c11dd5e8a2198dd0243c8ba85"
Jun 10 10:38:23.377476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:23.377451    2552 scope.go:117] "RemoveContainer" containerID="0a52d3e7bd4468e361f8f6ac264bc9623608cd42c8d90f60304f6726a20e77ba"
Jun 10 10:38:24.579942 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:38:24.579893    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" path="/var/lib/kubelet/pods/0c876ba5-854e-4014-9804-5ffecf1fdf18/volumes"
Jun 10 10:39:16.224830 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.224791    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"]
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225182    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="feast-init"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225195    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="feast-init"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225204    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225209    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225219    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="registry"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225227    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="registry"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225238    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225246    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225261    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="offline"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225268    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="offline"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225280    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="feast-apply"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225286    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="feast-apply"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225375    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="ui"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225389    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="registry"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225401    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="online"
Jun 10 10:39:16.226342 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.225410    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c876ba5-854e-4014-9804-5ffecf1fdf18" containerName="offline"
Jun 10 10:39:16.227963 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.227949    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.230569 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.230541    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 10 10:39:16.230717 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.230619    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 10 10:39:16.230717 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.230685    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 10 10:39:16.230838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.230746    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-qzkp2\""
Jun 10 10:39:16.230838 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.230831    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 10 10:39:16.230982 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.230901    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 10 10:39:16.231514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.231498    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 10 10:39:16.240875 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.240852    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"]
Jun 10 10:39:16.312801 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.312766    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxz5h\" (UniqueName: \"kubernetes.io/projected/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-kube-api-access-kxz5h\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.312801 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.312805    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.313095 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.312834    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.313095 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.312961    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.313095 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.312993    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.313095 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.313014    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.414391    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxz5h\" (UniqueName: \"kubernetes.io/projected/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-kube-api-access-kxz5h\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.414433    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414666 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.414562    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414666 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.414626    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414666 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.414659    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414819 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.414689    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.414819 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:39:16.414736    2552 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 10 10:39:16.414895 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:39:16.414821    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls podName:ac41b2de-c35b-42aa-ac85-aab177e2ecc3 nodeName:}" failed. No retries permitted until 2026-06-10 10:39:16.914797279 +0000 UTC m=+1244.771733695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-ps72n" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 10 10:39:16.415139 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.415120    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.415212 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.415185    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.417038 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.417020    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.417138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.417086    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.422650 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.422624    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxz5h\" (UniqueName: \"kubernetes.io/projected/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-kube-api-access-kxz5h\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.920833 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.920795    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:16.923338 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:16.923313    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ps72n\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:17.137502 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:17.137464    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:17.286260 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:17.286215    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"]
Jun 10 10:39:17.290994 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:39:17.290960    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac41b2de_c35b_42aa_ac85_aab177e2ecc3.slice/crio-f5da23ba2082e496527175118fd9f540659f8eb508b71892695c3f04d808f050 WatchSource:0}: Error finding container f5da23ba2082e496527175118fd9f540659f8eb508b71892695c3f04d808f050: Status 404 returned error can't find the container with id f5da23ba2082e496527175118fd9f540659f8eb508b71892695c3f04d808f050
Jun 10 10:39:17.560811 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:17.559870    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerStarted","Data":"fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023"}
Jun 10 10:39:17.560811 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:17.559949    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerStarted","Data":"f5da23ba2082e496527175118fd9f540659f8eb508b71892695c3f04d808f050"}
Jun 10 10:39:22.581647 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:22.581610    2552 generic.go:356] "Generic (PLEG): container finished" podID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerID="fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023" exitCode=0
Jun 10 10:39:22.582046 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:22.581674    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerDied","Data":"fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023"}
Jun 10 10:39:23.587703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:23.587671    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerStarted","Data":"352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61"}
Jun 10 10:39:28.609806 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:28.609771    2552 generic.go:356] "Generic (PLEG): container finished" podID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerID="352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61" exitCode=0
Jun 10 10:39:28.610225 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:28.609844    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerDied","Data":"352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61"}
Jun 10 10:39:29.619885 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:29.619846    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerStarted","Data":"90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9"}
Jun 10 10:39:29.619885 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:29.619892    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerStarted","Data":"19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865"}
Jun 10 10:39:29.620459 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:29.619919    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerStarted","Data":"9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b"}
Jun 10 10:39:29.668535 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:29.668464    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podStartSLOduration=13.668441795 podStartE2EDuration="13.668441795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:39:29.66611916 +0000 UTC m=+1257.523055591" watchObservedRunningTime="2026-06-10 10:39:29.668441795 +0000 UTC m=+1257.525378227"
Jun 10 10:39:32.137895 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:32.137848    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:32.138404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:32.137927    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:32.138404 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:32.137945    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:32.139876 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:32.139837    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
Jun 10 10:39:32.140079 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:32.139881    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jun 10 10:39:32.140079 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:32.139843    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jun 10 10:39:35.138791 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.138762    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.139331 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.138893    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.139331 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.139278    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.139331 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.139325    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.139522 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.139505    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.139721 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.139703    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.142786 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.142770    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.652266 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.652225    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:39:35.655195 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:39:35.655171    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:40:37.732251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.732211    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"]
Jun 10 10:40:37.732788 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.732439    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online" containerID="cri-o://9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b" gracePeriod=30
Jun 10 10:40:37.732788 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.732485    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui" containerID="cri-o://90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9" gracePeriod=30
Jun 10 10:40:37.732788 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.732508    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="offline" containerID="cri-o://19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865" gracePeriod=30
Jun 10 10:40:37.880434 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.880396    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"]
Jun 10 10:40:37.880712 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.880677    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="registry" containerID="cri-o://8112076a1c1c30c2b0438aef67f927197f6273ad7a24fa7d26ae3423ba7f5062" gracePeriod=30
Jun 10 10:40:37.880936 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.880754    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui" containerID="cri-o://d2b53a7cf75a0d206cad7563d48b5a0d8a9a68d2fda765271a23571c94320d5f" gracePeriod=30
Jun 10 10:40:37.881049 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.880751    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online" containerID="cri-o://9acfce5ef249f8999920bc379e2be9561ed59fa9a34fb5fc3688eafbe4b4217d" gracePeriod=30
Jun 10 10:40:37.881121 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:37.880789    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="offline" containerID="cri-o://5b40b07d533450f41ee0fbcfcc3fe7db631303bf5d7f8f4692d554694a8a1542" gracePeriod=30
Jun 10 10:40:38.923714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.923678    2552 generic.go:356] "Generic (PLEG): container finished" podID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerID="d2b53a7cf75a0d206cad7563d48b5a0d8a9a68d2fda765271a23571c94320d5f" exitCode=0
Jun 10 10:40:38.923714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.923703    2552 generic.go:356] "Generic (PLEG): container finished" podID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerID="9acfce5ef249f8999920bc379e2be9561ed59fa9a34fb5fc3688eafbe4b4217d" exitCode=0
Jun 10 10:40:38.924212 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.923752    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"d2b53a7cf75a0d206cad7563d48b5a0d8a9a68d2fda765271a23571c94320d5f"}
Jun 10 10:40:38.924212 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.923794    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"9acfce5ef249f8999920bc379e2be9561ed59fa9a34fb5fc3688eafbe4b4217d"}
Jun 10 10:40:38.926463 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.926441    2552 generic.go:356] "Generic (PLEG): container finished" podID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerID="90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9" exitCode=0
Jun 10 10:40:38.926463 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.926460    2552 generic.go:356] "Generic (PLEG): container finished" podID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerID="9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b" exitCode=0
Jun 10 10:40:38.926603 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.926510    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerDied","Data":"90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9"}
Jun 10 10:40:38.926603 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:38.926547    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerDied","Data":"9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b"}
Jun 10 10:40:43.288259 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:43.288213    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jun 10 10:40:43.288669 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:43.288268    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jun 10 10:40:45.139498 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:45.139448    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jun 10 10:40:45.652983 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:45.652944    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jun 10 10:40:53.288028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:53.287933    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jun 10 10:40:53.288028 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:53.287953    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jun 10 10:40:55.140159 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:55.140106    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jun 10 10:40:55.652989 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:40:55.652946    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jun 10 10:41:03.288495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:03.288449    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jun 10 10:41:03.288495 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:03.288471    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jun 10 10:41:03.288956 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:03.288576    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:41:03.288956 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:03.288622    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:41:05.139894 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:05.139854    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jun 10 10:41:05.140326 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:05.140003    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:41:05.653309 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:05.653267    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jun 10 10:41:05.653497 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:05.653428    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:41:07.991891 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.991826    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:41:07.999521 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.999499    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-feast-data\") pod \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") "
Jun 10 10:41:07.999658 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.999528    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls\") pod \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") "
Jun 10 10:41:07.999658 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.999558    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-online-tls\") pod \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") "
Jun 10 10:41:07.999658 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.999582    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-offline-tls\") pod \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") "
Jun 10 10:41:07.999658 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.999609    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxz5h\" (UniqueName: \"kubernetes.io/projected/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-kube-api-access-kxz5h\") pod \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") "
Jun 10 10:41:07.999888 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:07.999665    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-registry-tls\") pod \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\" (UID: \"ac41b2de-c35b-42aa-ac85-aab177e2ecc3\") "
Jun 10 10:41:08.000064 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.000035    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-feast-data" (OuterVolumeSpecName: "feast-data") pod "ac41b2de-c35b-42aa-ac85-aab177e2ecc3" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:41:08.000150 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.000072    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ac41b2de-c35b-42aa-ac85-aab177e2ecc3" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:41:08.001936 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.001883    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ac41b2de-c35b-42aa-ac85-aab177e2ecc3" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.001936 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.001901    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ac41b2de-c35b-42aa-ac85-aab177e2ecc3" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.002069 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.001936    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-online-tls" (OuterVolumeSpecName: "online-tls") pod "ac41b2de-c35b-42aa-ac85-aab177e2ecc3" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.002069 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.001969    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-kube-api-access-kxz5h" (OuterVolumeSpecName: "kube-api-access-kxz5h") pod "ac41b2de-c35b-42aa-ac85-aab177e2ecc3" (UID: "ac41b2de-c35b-42aa-ac85-aab177e2ecc3"). InnerVolumeSpecName "kube-api-access-kxz5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:41:08.052645 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.052613    2552 generic.go:356] "Generic (PLEG): container finished" podID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerID="5b40b07d533450f41ee0fbcfcc3fe7db631303bf5d7f8f4692d554694a8a1542" exitCode=137
Jun 10 10:41:08.052645 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.052641    2552 generic.go:356] "Generic (PLEG): container finished" podID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerID="8112076a1c1c30c2b0438aef67f927197f6273ad7a24fa7d26ae3423ba7f5062" exitCode=137
Jun 10 10:41:08.052876 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.052682    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"5b40b07d533450f41ee0fbcfcc3fe7db631303bf5d7f8f4692d554694a8a1542"}
Jun 10 10:41:08.052876 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.052724    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"8112076a1c1c30c2b0438aef67f927197f6273ad7a24fa7d26ae3423ba7f5062"}
Jun 10 10:41:08.055004 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.054974    2552 generic.go:356] "Generic (PLEG): container finished" podID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerID="19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865" exitCode=137
Jun 10 10:41:08.055137 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.055018    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerDied","Data":"19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865"}
Jun 10 10:41:08.055137 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.055045    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"
Jun 10 10:41:08.055137 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.055064    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n" event={"ID":"ac41b2de-c35b-42aa-ac85-aab177e2ecc3","Type":"ContainerDied","Data":"f5da23ba2082e496527175118fd9f540659f8eb508b71892695c3f04d808f050"}
Jun 10 10:41:08.055137 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.055084    2552 scope.go:117] "RemoveContainer" containerID="90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9"
Jun 10 10:41:08.064149 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.064131    2552 scope.go:117] "RemoveContainer" containerID="19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865"
Jun 10 10:41:08.071712 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.071697    2552 scope.go:117] "RemoveContainer" containerID="9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b"
Jun 10 10:41:08.078050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.078024    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"]
Jun 10 10:41:08.080373 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.080353    2552 scope.go:117] "RemoveContainer" containerID="352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61"
Jun 10 10:41:08.081112 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.081094    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ps72n"]
Jun 10 10:41:08.087653 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.087636    2552 scope.go:117] "RemoveContainer" containerID="fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023"
Jun 10 10:41:08.094743 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.094727    2552 scope.go:117] "RemoveContainer" containerID="90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9"
Jun 10 10:41:08.095002 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:08.094975    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9\": container with ID starting with 90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9 not found: ID does not exist" containerID="90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9"
Jun 10 10:41:08.095087 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095003    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9"} err="failed to get container status \"90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9\": rpc error: code = NotFound desc = could not find container \"90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9\": container with ID starting with 90a625d1cd2591a4eb7852476b0fb01dd0e633bb34741a99054b7410ec0551a9 not found: ID does not exist"
Jun 10 10:41:08.095087 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095029    2552 scope.go:117] "RemoveContainer" containerID="19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865"
Jun 10 10:41:08.095250 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:08.095235    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865\": container with ID starting with 19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865 not found: ID does not exist" containerID="19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865"
Jun 10 10:41:08.095307 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095257    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865"} err="failed to get container status \"19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865\": rpc error: code = NotFound desc = could not find container \"19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865\": container with ID starting with 19215553ea1c631bff4794e344ebc39b6df23240f4b97382514d36c5c32ab865 not found: ID does not exist"
Jun 10 10:41:08.095307 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095276    2552 scope.go:117] "RemoveContainer" containerID="9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b"
Jun 10 10:41:08.095482 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:08.095465    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b\": container with ID starting with 9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b not found: ID does not exist" containerID="9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b"
Jun 10 10:41:08.095522 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095487    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b"} err="failed to get container status \"9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b\": rpc error: code = NotFound desc = could not find container \"9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b\": container with ID starting with 9e38fd26c8acad8f3841663eaf61b694a310b43d728d6d99d57689264bc6326b not found: ID does not exist"
Jun 10 10:41:08.095522 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095507    2552 scope.go:117] "RemoveContainer" containerID="352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61"
Jun 10 10:41:08.095710 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:08.095693    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61\": container with ID starting with 352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61 not found: ID does not exist" containerID="352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61"
Jun 10 10:41:08.095775 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095717    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61"} err="failed to get container status \"352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61\": rpc error: code = NotFound desc = could not find container \"352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61\": container with ID starting with 352ad106af08bdf27752f669420edbc752dd2bc661df02c8b9baacdb3cd57b61 not found: ID does not exist"
Jun 10 10:41:08.095775 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095736    2552 scope.go:117] "RemoveContainer" containerID="fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023"
Jun 10 10:41:08.095961 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:08.095942    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023\": container with ID starting with fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023 not found: ID does not exist" containerID="fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023"
Jun 10 10:41:08.096024 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.095966    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023"} err="failed to get container status \"fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023\": rpc error: code = NotFound desc = could not find container \"fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023\": container with ID starting with fdf4e4e1b1f179e873e89038f2c1d2175372ab321b22f0e9a2ba150aea83d023 not found: ID does not exist"
Jun 10 10:41:08.100391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.100375    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.100438 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.100393    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.100438 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.100401    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.100438 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.100409    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.100438 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.100417    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxz5h\" (UniqueName: \"kubernetes.io/projected/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-kube-api-access-kxz5h\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.100438 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.100427    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac41b2de-c35b-42aa-ac85-aab177e2ecc3-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.520551 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.520527    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:41:08.579488 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.579457    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" path="/var/lib/kubelet/pods/ac41b2de-c35b-42aa-ac85-aab177e2ecc3/volumes"
Jun 10 10:41:08.606220 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606183    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-offline-tls\") pod \"3fe5ab36-3dc0-4715-93e5-12892548fc56\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") "
Jun 10 10:41:08.606505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606262    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwqk2\" (UniqueName: \"kubernetes.io/projected/3fe5ab36-3dc0-4715-93e5-12892548fc56-kube-api-access-dwqk2\") pod \"3fe5ab36-3dc0-4715-93e5-12892548fc56\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") "
Jun 10 10:41:08.606505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606292    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") pod \"3fe5ab36-3dc0-4715-93e5-12892548fc56\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") "
Jun 10 10:41:08.606505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606328    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-registry-tls\") pod \"3fe5ab36-3dc0-4715-93e5-12892548fc56\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") "
Jun 10 10:41:08.606505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606355    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe5ab36-3dc0-4715-93e5-12892548fc56-feast-data\") pod \"3fe5ab36-3dc0-4715-93e5-12892548fc56\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") "
Jun 10 10:41:08.606505 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606411    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls\") pod \"3fe5ab36-3dc0-4715-93e5-12892548fc56\" (UID: \"3fe5ab36-3dc0-4715-93e5-12892548fc56\") "
Jun 10 10:41:08.606998 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.606967    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe5ab36-3dc0-4715-93e5-12892548fc56-feast-data" (OuterVolumeSpecName: "feast-data") pod "3fe5ab36-3dc0-4715-93e5-12892548fc56" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:41:08.608542 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.608515    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3fe5ab36-3dc0-4715-93e5-12892548fc56" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.608638 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.608550    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3fe5ab36-3dc0-4715-93e5-12892548fc56" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.608638 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.608563    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe5ab36-3dc0-4715-93e5-12892548fc56-kube-api-access-dwqk2" (OuterVolumeSpecName: "kube-api-access-dwqk2") pod "3fe5ab36-3dc0-4715-93e5-12892548fc56" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56"). InnerVolumeSpecName "kube-api-access-dwqk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:41:08.608830 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.608807    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls" (OuterVolumeSpecName: "online-tls") pod "3fe5ab36-3dc0-4715-93e5-12892548fc56" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.608867 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.608821    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3fe5ab36-3dc0-4715-93e5-12892548fc56" (UID: "3fe5ab36-3dc0-4715-93e5-12892548fc56"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:41:08.707170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.707080    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.707170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.707108    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.707170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.707120    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwqk2\" (UniqueName: \"kubernetes.io/projected/3fe5ab36-3dc0-4715-93e5-12892548fc56-kube-api-access-dwqk2\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.707170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.707130    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.707170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.707138    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3fe5ab36-3dc0-4715-93e5-12892548fc56-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:08.707170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:08.707147    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe5ab36-3dc0-4715-93e5-12892548fc56-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:41:09.062610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.062516    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"
Jun 10 10:41:09.062610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.062524    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g" event={"ID":"3fe5ab36-3dc0-4715-93e5-12892548fc56","Type":"ContainerDied","Data":"79e74a4b4a747119a01fadb5f64d3089a02a40873330c470381e48e64880d1db"}
Jun 10 10:41:09.062610 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.062571    2552 scope.go:117] "RemoveContainer" containerID="d2b53a7cf75a0d206cad7563d48b5a0d8a9a68d2fda765271a23571c94320d5f"
Jun 10 10:41:09.071636 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.071621    2552 scope.go:117] "RemoveContainer" containerID="5b40b07d533450f41ee0fbcfcc3fe7db631303bf5d7f8f4692d554694a8a1542"
Jun 10 10:41:09.079381 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.079362    2552 scope.go:117] "RemoveContainer" containerID="9acfce5ef249f8999920bc379e2be9561ed59fa9a34fb5fc3688eafbe4b4217d"
Jun 10 10:41:09.086611 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.086588    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"]
Jun 10 10:41:09.087094 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.087076    2552 scope.go:117] "RemoveContainer" containerID="8112076a1c1c30c2b0438aef67f927197f6273ad7a24fa7d26ae3423ba7f5062"
Jun 10 10:41:09.090461 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.090440    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wm85g"]
Jun 10 10:41:09.095066 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.095050    2552 scope.go:117] "RemoveContainer" containerID="1aa0b67e7102b6350a7a1abe6f4de881b7e838f15d6c675fa75665eef09fbcc6"
Jun 10 10:41:09.102147 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:09.102131    2552 scope.go:117] "RemoveContainer" containerID="28a18400d052b90bfb1a3b5231acdcd1a4a44fe5ab3150cbed38f6b624b1c0ec"
Jun 10 10:41:10.580218 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:10.580178    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" path="/var/lib/kubelet/pods/3fe5ab36-3dc0-4715-93e5-12892548fc56/volumes"
Jun 10 10:41:51.439933 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.439886    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"]
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440231    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="registry"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440242    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="registry"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440252    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440258    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440266    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="offline"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440272    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="offline"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440282    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="feast-init"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440288    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="feast-init"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440294    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440299    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440305    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="feast-apply"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440311    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="feast-apply"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440320    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440324    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440329    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440334    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440343    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="feast-apply"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440348    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="feast-apply"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440358    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="feast-init"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440363    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="feast-init"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440368    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="offline"
Jun 10 10:41:51.440370 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440373    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="offline"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440424    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="ui"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440433    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="offline"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440439    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="ui"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440445    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="online"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440453    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="registry"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440458    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac41b2de-c35b-42aa-ac85-aab177e2ecc3" containerName="offline"
Jun 10 10:41:51.441058 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.440463    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe5ab36-3dc0-4715-93e5-12892548fc56" containerName="online"
Jun 10 10:41:51.445235 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.445216    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.458368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.458338    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 10 10:41:51.459109 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.459092    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 10 10:41:51.459333 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.459319    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 10 10:41:51.459630 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.459617    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 10 10:41:51.459923 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.459896    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 10 10:41:51.463525 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.463507    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bwt5z\""
Jun 10 10:41:51.463731 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.463716    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 10 10:41:51.483391 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.483360    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"]
Jun 10 10:41:51.578376 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.578331    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.578376 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.578379    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.578595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.578465    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.578595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.578524    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxnt\" (UniqueName: \"kubernetes.io/projected/a74078a3-07ba-4b2c-9447-2d06e3a411ae-kube-api-access-prxnt\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.578595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.578560    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.578595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.578582    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a74078a3-07ba-4b2c-9447-2d06e3a411ae-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679321 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679267    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679338    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxnt\" (UniqueName: \"kubernetes.io/projected/a74078a3-07ba-4b2c-9447-2d06e3a411ae-kube-api-access-prxnt\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679373    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679487 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679394    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a74078a3-07ba-4b2c-9447-2d06e3a411ae-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679487 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:51.679425    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:41:51.679689 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:41:51.679521    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls podName:a74078a3-07ba-4b2c-9447-2d06e3a411ae nodeName:}" failed. No retries permitted until 2026-06-10 10:41:52.179497605 +0000 UTC m=+1400.036434030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls") pod "feast-simple-feast-setup-75c64c888b-z25r8" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:41:51.679689 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679429    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679689 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.679879 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.679806    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a74078a3-07ba-4b2c-9447-2d06e3a411ae-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.682051 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.682026    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.682215 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.682197    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.682257 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.682197    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:51.698685 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:51.698608    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxnt\" (UniqueName: \"kubernetes.io/projected/a74078a3-07ba-4b2c-9447-2d06e3a411ae-kube-api-access-prxnt\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:52.184199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:52.184137    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:52.186797 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:52.186764    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-z25r8\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:52.371061 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:52.371012    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:41:52.535056 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:52.535025    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"]
Jun 10 10:41:52.537318 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:41:52.537291    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda74078a3_07ba_4b2c_9447_2d06e3a411ae.slice/crio-14380ba97aaace56fec0c3a960c7d4d64be4722bff3865c5f4f6f242cbc3aab7 WatchSource:0}: Error finding container 14380ba97aaace56fec0c3a960c7d4d64be4722bff3865c5f4f6f242cbc3aab7: Status 404 returned error can't find the container with id 14380ba97aaace56fec0c3a960c7d4d64be4722bff3865c5f4f6f242cbc3aab7
Jun 10 10:41:53.242117 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:53.242074    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"91a0d3943bc9a6b465c0e20e5acd30276788241d06d20c9d04b28ab6c3a39194"}
Jun 10 10:41:53.242349 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:53.242131    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"14380ba97aaace56fec0c3a960c7d4d64be4722bff3865c5f4f6f242cbc3aab7"}
Jun 10 10:41:58.265584 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:58.265546    2552 generic.go:356] "Generic (PLEG): container finished" podID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerID="91a0d3943bc9a6b465c0e20e5acd30276788241d06d20c9d04b28ab6c3a39194" exitCode=0
Jun 10 10:41:58.266225 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:58.265621    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"91a0d3943bc9a6b465c0e20e5acd30276788241d06d20c9d04b28ab6c3a39194"}
Jun 10 10:41:59.272264 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:41:59.272221    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"348b0054970ca0b7cecec460421bd407d2dffd9120a7b794287cfaa7dbe0092f"}
Jun 10 10:42:04.295449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:04.295414    2552 generic.go:356] "Generic (PLEG): container finished" podID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerID="348b0054970ca0b7cecec460421bd407d2dffd9120a7b794287cfaa7dbe0092f" exitCode=0
Jun 10 10:42:04.295877 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:04.295493    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"348b0054970ca0b7cecec460421bd407d2dffd9120a7b794287cfaa7dbe0092f"}
Jun 10 10:42:05.305975 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:05.305934    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"06efec23de9d279a4cc5c3a44cd71f9eacb890cc6cd60a6874ea3a450def9d07"}
Jun 10 10:42:05.306592 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:05.306549    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"a9cffda21b61a109335882c24a55ec9ee44011efc9f55034fa2a20a75d434cfc"}
Jun 10 10:42:05.306705 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:05.306604    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"8282a4fbcfe361950ae27d9fdd7df1d2b0091875db63cdf62246a813bfc3f6d0"}
Jun 10 10:42:05.306705 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:05.306639    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerStarted","Data":"4664488d3f74875ee20d95fbd3a3aad3d9221ba5f5d485f0be45a93af938fa5a"}
Jun 10 10:42:05.355864 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:05.355793    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podStartSLOduration=14.355769015 podStartE2EDuration="14.355769015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:41:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:42:05.354532114 +0000 UTC m=+1413.211468710" watchObservedRunningTime="2026-06-10 10:42:05.355769015 +0000 UTC m=+1413.212705447"
Jun 10 10:42:07.371863 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.371804    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:07.372395 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.371985    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:07.372395 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.372031    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:07.372395 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.372050    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:07.374185 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.374142    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.35:8816: connect: connection refused"
Jun 10 10:42:07.374358 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.374156    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Jun 10 10:42:07.374358 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.374205    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Jun 10 10:42:07.374358 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:07.374309    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.35:6571: connect: connection refused"
Jun 10 10:42:10.372235 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:10.372202    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:10.372738 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:10.372720    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:10.372853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:10.372841    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:10.372892 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:10.372866    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:10.372952 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:10.372943    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:10.376951 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:10.376934    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:11.339371 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:11.339330    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:11.339597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:11.339388    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:11.339597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:11.339406    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:11.339966 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:11.339948    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:11.340048 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:11.340001    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:42:11.342336 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:42:11.342316    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:43:12.616365 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.616333    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"]
Jun 10 10:43:12.616940 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.616536    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="registry" containerID="cri-o://4664488d3f74875ee20d95fbd3a3aad3d9221ba5f5d485f0be45a93af938fa5a" gracePeriod=30
Jun 10 10:43:12.616940 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.616585    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui" containerID="cri-o://06efec23de9d279a4cc5c3a44cd71f9eacb890cc6cd60a6874ea3a450def9d07" gracePeriod=30
Jun 10 10:43:12.616940 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.616595    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="offline" containerID="cri-o://a9cffda21b61a109335882c24a55ec9ee44011efc9f55034fa2a20a75d434cfc" gracePeriod=30
Jun 10 10:43:12.616940 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.616648    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online" containerID="cri-o://8282a4fbcfe361950ae27d9fdd7df1d2b0091875db63cdf62246a813bfc3f6d0" gracePeriod=30
Jun 10 10:43:12.971508 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.971417    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"]
Jun 10 10:43:12.975714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.975686    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:12.978565 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.978540    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lsqpk\""
Jun 10 10:43:12.994417 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:12.994380    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"]
Jun 10 10:43:13.131330 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.131295    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbhcg\" (UniqueName: \"kubernetes.io/projected/1644133d-2818-4349-a26b-825e3449ceb5-kube-api-access-fbhcg\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.131513 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.131423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.131513 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.131463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.131513 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.131497    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.131629 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.131514    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.131689 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.131668    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1644133d-2818-4349-a26b-825e3449ceb5-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232491 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.232390    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232491 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.232432    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232491 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.232460    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:43:13.232548    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.232570    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.232630    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1644133d-2818-4349-a26b-825e3449ceb5-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:43:13.232674    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls podName:1644133d-2818-4349-a26b-825e3449ceb5 nodeName:}" failed. No retries permitted until 2026-06-10 10:43:13.732650898 +0000 UTC m=+1481.589587320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls") pod "feast-simple-feast-setup-75c64c888b-hpwln" (UID: "1644133d-2818-4349-a26b-825e3449ceb5") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:43:13.232548    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.232726    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbhcg\" (UniqueName: \"kubernetes.io/projected/1644133d-2818-4349-a26b-825e3449ceb5-kube-api-access-fbhcg\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.232853 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:43:13.232764    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls podName:1644133d-2818-4349-a26b-825e3449ceb5 nodeName:}" failed. No retries permitted until 2026-06-10 10:43:13.732744704 +0000 UTC m=+1481.589681117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls") pod "feast-simple-feast-setup-75c64c888b-hpwln" (UID: "1644133d-2818-4349-a26b-825e3449ceb5") : secret "feast-simple-feast-setup-online-tls" not found
Jun 10 10:43:13.233239 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.233072    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1644133d-2818-4349-a26b-825e3449ceb5-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.235177 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.235146    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.235286 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.235183    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.245860 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.245835    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbhcg\" (UniqueName: \"kubernetes.io/projected/1644133d-2818-4349-a26b-825e3449ceb5-kube-api-access-fbhcg\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.598934 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.598831    2552 generic.go:356] "Generic (PLEG): container finished" podID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerID="06efec23de9d279a4cc5c3a44cd71f9eacb890cc6cd60a6874ea3a450def9d07" exitCode=0
Jun 10 10:43:13.598934 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.598856    2552 generic.go:356] "Generic (PLEG): container finished" podID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerID="8282a4fbcfe361950ae27d9fdd7df1d2b0091875db63cdf62246a813bfc3f6d0" exitCode=0
Jun 10 10:43:13.598934 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.598901    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"06efec23de9d279a4cc5c3a44cd71f9eacb890cc6cd60a6874ea3a450def9d07"}
Jun 10 10:43:13.599148 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.598961    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"8282a4fbcfe361950ae27d9fdd7df1d2b0091875db63cdf62246a813bfc3f6d0"}
Jun 10 10:43:13.736777 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.736738    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.736777 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.736775    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.739165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.739144    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.739254 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.739210    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpwln\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:13.887354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:13.887325    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:14.030312 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:14.030261    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"]
Jun 10 10:43:14.033540 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:43:14.033516    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1644133d_2818_4349_a26b_825e3449ceb5.slice/crio-d741464a46273dd6eb8d3a3f84770d042eb5c66ef58f420b5d4f23f2ea5fe8f2 WatchSource:0}: Error finding container d741464a46273dd6eb8d3a3f84770d042eb5c66ef58f420b5d4f23f2ea5fe8f2: Status 404 returned error can't find the container with id d741464a46273dd6eb8d3a3f84770d042eb5c66ef58f420b5d4f23f2ea5fe8f2
Jun 10 10:43:14.604355 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:14.604321    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"}
Jun 10 10:43:14.604355 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:14.604363    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"d741464a46273dd6eb8d3a3f84770d042eb5c66ef58f420b5d4f23f2ea5fe8f2"}
Jun 10 10:43:19.627476 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:19.627439    2552 generic.go:356] "Generic (PLEG): container finished" podID="1644133d-2818-4349-a26b-825e3449ceb5" containerID="daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac" exitCode=0
Jun 10 10:43:19.628034 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:19.627514    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"}
Jun 10 10:43:20.633027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:20.632992    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"}
Jun 10 10:43:21.339618 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:21.339568    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Jun 10 10:43:21.339829 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:21.339571    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Jun 10 10:43:25.660960 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:25.660902    2552 generic.go:356] "Generic (PLEG): container finished" podID="1644133d-2818-4349-a26b-825e3449ceb5" containerID="7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee" exitCode=0
Jun 10 10:43:25.660960 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:25.660947    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"}
Jun 10 10:43:26.672870 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:26.672829    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"}
Jun 10 10:43:26.673388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:26.672893    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"}
Jun 10 10:43:26.673388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:26.672947    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"}
Jun 10 10:43:26.673388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:26.672968    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerStarted","Data":"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"}
Jun 10 10:43:26.697999 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:26.697933    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podStartSLOduration=14.697891359 podStartE2EDuration="14.697891359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:43:26.696499338 +0000 UTC m=+1494.553435826" watchObservedRunningTime="2026-06-10 10:43:26.697891359 +0000 UTC m=+1494.554827793"
Jun 10 10:43:28.888463 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.888408    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:28.888985 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.888504    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:28.888985 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.888526    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:28.888985 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.888543    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:28.890573 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.890530    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jun 10 10:43:28.890719 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.890559    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.36:8816: connect: connection refused"
Jun 10 10:43:28.890719 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.890572    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
Jun 10 10:43:28.890719 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:28.890659    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jun 10 10:43:31.339519 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.339467    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Jun 10 10:43:31.340025 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.339473    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Jun 10 10:43:31.889213 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.889181    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.889383 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.889309    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.889579 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.889558    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.890019 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.889991    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.890144 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.890033    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.890144 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.890053    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.890353 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.890337    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.890453 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.890436    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.890527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.890512    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:31.893977 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:31.893960    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:32.713522 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:32.709781    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:32.716627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:32.716603    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:43:41.339871 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:41.339823    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Jun 10 10:43:41.339871 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:41.339854    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Jun 10 10:43:41.340355 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:41.340004    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:43:41.340355 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:41.340078    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:43:42.758104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:42.758069    2552 generic.go:356] "Generic (PLEG): container finished" podID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerID="a9cffda21b61a109335882c24a55ec9ee44011efc9f55034fa2a20a75d434cfc" exitCode=137
Jun 10 10:43:42.758104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:42.758100    2552 generic.go:356] "Generic (PLEG): container finished" podID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerID="4664488d3f74875ee20d95fbd3a3aad3d9221ba5f5d485f0be45a93af938fa5a" exitCode=137
Jun 10 10:43:42.758546 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:42.758145    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"a9cffda21b61a109335882c24a55ec9ee44011efc9f55034fa2a20a75d434cfc"}
Jun 10 10:43:42.758546 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:42.758191    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"4664488d3f74875ee20d95fbd3a3aad3d9221ba5f5d485f0be45a93af938fa5a"}
Jun 10 10:43:43.267191 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.267166    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:43:43.415874 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.415782    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-offline-tls\") pod \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") "
Jun 10 10:43:43.415874 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.415819    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-registry-tls\") pod \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") "
Jun 10 10:43:43.415874 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.415842    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prxnt\" (UniqueName: \"kubernetes.io/projected/a74078a3-07ba-4b2c-9447-2d06e3a411ae-kube-api-access-prxnt\") pod \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") "
Jun 10 10:43:43.416176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.415888    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a74078a3-07ba-4b2c-9447-2d06e3a411ae-feast-data\") pod \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") "
Jun 10 10:43:43.416176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.416020    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-online-tls\") pod \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") "
Jun 10 10:43:43.416176 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.416051    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls\") pod \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\" (UID: \"a74078a3-07ba-4b2c-9447-2d06e3a411ae\") "
Jun 10 10:43:43.416536 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.416510    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a74078a3-07ba-4b2c-9447-2d06e3a411ae-feast-data" (OuterVolumeSpecName: "feast-data") pod "a74078a3-07ba-4b2c-9447-2d06e3a411ae" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:43:43.418303 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.418279    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74078a3-07ba-4b2c-9447-2d06e3a411ae-kube-api-access-prxnt" (OuterVolumeSpecName: "kube-api-access-prxnt") pod "a74078a3-07ba-4b2c-9447-2d06e3a411ae" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae"). InnerVolumeSpecName "kube-api-access-prxnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:43:43.418462 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.418446    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a74078a3-07ba-4b2c-9447-2d06e3a411ae" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:43:43.418530 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.418475    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a74078a3-07ba-4b2c-9447-2d06e3a411ae" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:43:43.418595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.418574    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a74078a3-07ba-4b2c-9447-2d06e3a411ae" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:43:43.418632 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.418589    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-online-tls" (OuterVolumeSpecName: "online-tls") pod "a74078a3-07ba-4b2c-9447-2d06e3a411ae" (UID: "a74078a3-07ba-4b2c-9447-2d06e3a411ae"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:43:43.517548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.517517    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a74078a3-07ba-4b2c-9447-2d06e3a411ae-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:43:43.517548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.517545    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:43:43.517548 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.517554    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:43:43.517782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.517561    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:43:43.517782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.517569    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a74078a3-07ba-4b2c-9447-2d06e3a411ae-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:43:43.517782 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.517578    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prxnt\" (UniqueName: \"kubernetes.io/projected/a74078a3-07ba-4b2c-9447-2d06e3a411ae-kube-api-access-prxnt\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:43:43.765707 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.765625    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8" event={"ID":"a74078a3-07ba-4b2c-9447-2d06e3a411ae","Type":"ContainerDied","Data":"14380ba97aaace56fec0c3a960c7d4d64be4722bff3865c5f4f6f242cbc3aab7"}
Jun 10 10:43:43.765707 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.765680    2552 scope.go:117] "RemoveContainer" containerID="06efec23de9d279a4cc5c3a44cd71f9eacb890cc6cd60a6874ea3a450def9d07"
Jun 10 10:43:43.766141 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.765636    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"
Jun 10 10:43:43.775234 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.775217    2552 scope.go:117] "RemoveContainer" containerID="a9cffda21b61a109335882c24a55ec9ee44011efc9f55034fa2a20a75d434cfc"
Jun 10 10:43:43.782881 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.782857    2552 scope.go:117] "RemoveContainer" containerID="8282a4fbcfe361950ae27d9fdd7df1d2b0091875db63cdf62246a813bfc3f6d0"
Jun 10 10:43:43.790561 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.790539    2552 scope.go:117] "RemoveContainer" containerID="4664488d3f74875ee20d95fbd3a3aad3d9221ba5f5d485f0be45a93af938fa5a"
Jun 10 10:43:43.795786 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.795766    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"]
Jun 10 10:43:43.798871 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.798854    2552 scope.go:117] "RemoveContainer" containerID="348b0054970ca0b7cecec460421bd407d2dffd9120a7b794287cfaa7dbe0092f"
Jun 10 10:43:43.801856 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.801832    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-z25r8"]
Jun 10 10:43:43.806655 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:43.806628    2552 scope.go:117] "RemoveContainer" containerID="91a0d3943bc9a6b465c0e20e5acd30276788241d06d20c9d04b28ab6c3a39194"
Jun 10 10:43:44.579690 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:43:44.579654    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" path="/var/lib/kubelet/pods/a74078a3-07ba-4b2c-9447-2d06e3a411ae/volumes"
Jun 10 10:44:34.540588 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540550    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"]
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540928    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="feast-init"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540940    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="feast-init"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540953    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="offline"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540959    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="offline"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540974    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="registry"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540981    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="registry"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540988    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="feast-apply"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.540993    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="feast-apply"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541000    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541005    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541013    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online"
Jun 10 10:44:34.541050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541018    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online"
Jun 10 10:44:34.541431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541070    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="ui"
Jun 10 10:44:34.541431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541078    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="online"
Jun 10 10:44:34.541431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541088    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="registry"
Jun 10 10:44:34.541431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.541094    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74078a3-07ba-4b2c-9447-2d06e3a411ae" containerName="offline"
Jun 10 10:44:34.545502 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.545482    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.549965 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.549937    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 10 10:44:34.550088 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.550006    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 10 10:44:34.550169 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.550113    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 10 10:44:34.550242 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.550226    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 10 10:44:34.550317 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.550240    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 10 10:44:34.550317 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.550247    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-vp54x\""
Jun 10 10:44:34.551082 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.551062    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 10 10:44:34.567104 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.567076    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"]
Jun 10 10:44:34.586916 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.586874    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.587110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.586937    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/346b3c1e-cd99-4b06-a096-6948b931916a-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.587110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.587016    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwrm\" (UniqueName: \"kubernetes.io/projected/346b3c1e-cd99-4b06-a096-6948b931916a-kube-api-access-zdwrm\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.587110 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.587060    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.587257 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.587142    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.587257 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.587169    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/346b3c1e-cd99-4b06-a096-6948b931916a-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.687974 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.687934    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.687985    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/346b3c1e-cd99-4b06-a096-6948b931916a-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.688014    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688170 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.688048    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/346b3c1e-cd99-4b06-a096-6948b931916a-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688359 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.688224    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwrm\" (UniqueName: \"kubernetes.io/projected/346b3c1e-cd99-4b06-a096-6948b931916a-kube-api-access-zdwrm\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688359 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.688268    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688468 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:44:34.688375    2552 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 10 10:44:34.688468 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.688431    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/346b3c1e-cd99-4b06-a096-6948b931916a-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.688468 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:44:34.688452    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls podName:346b3c1e-cd99-4b06-a096-6948b931916a nodeName:}" failed. No retries permitted until 2026-06-10 10:44:35.188431576 +0000 UTC m=+1563.045368001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-bbxkq" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 10 10:44:34.689240 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.689215    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/346b3c1e-cd99-4b06-a096-6948b931916a-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.690524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.690500    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.690614 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.690545    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:34.698129 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:34.698105    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwrm\" (UniqueName: \"kubernetes.io/projected/346b3c1e-cd99-4b06-a096-6948b931916a-kube-api-access-zdwrm\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:35.192692 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:35.192653    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:35.195097 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:35.195071    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-bbxkq\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:35.455303 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:35.455199    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:35.597849 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:35.597825    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"]
Jun 10 10:44:35.600379 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:44:35.600352    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod346b3c1e_cd99_4b06_a096_6948b931916a.slice/crio-32450bf9cf6d06522ea8cf6d6663ae8f27cd820388a3719c5b24d80c06a1f363 WatchSource:0}: Error finding container 32450bf9cf6d06522ea8cf6d6663ae8f27cd820388a3719c5b24d80c06a1f363: Status 404 returned error can't find the container with id 32450bf9cf6d06522ea8cf6d6663ae8f27cd820388a3719c5b24d80c06a1f363
Jun 10 10:44:35.980639 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:35.980598    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerStarted","Data":"45cb38e529cbf2b056e89e479a7d77b8f9e32b9af466d3f63d2bfda14388e791"}
Jun 10 10:44:35.980816 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:35.980650    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerStarted","Data":"32450bf9cf6d06522ea8cf6d6663ae8f27cd820388a3719c5b24d80c06a1f363"}
Jun 10 10:44:41.007001 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:41.006966    2552 generic.go:356] "Generic (PLEG): container finished" podID="346b3c1e-cd99-4b06-a096-6948b931916a" containerID="45cb38e529cbf2b056e89e479a7d77b8f9e32b9af466d3f63d2bfda14388e791" exitCode=0
Jun 10 10:44:41.007400 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:41.007008    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerDied","Data":"45cb38e529cbf2b056e89e479a7d77b8f9e32b9af466d3f63d2bfda14388e791"}
Jun 10 10:44:42.013512 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:42.013480    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerStarted","Data":"d8443e2f061febfcd761f4b2e389808466c3a34ba43665d2b48697583c18baa2"}
Jun 10 10:44:47.036144 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:47.036061    2552 generic.go:356] "Generic (PLEG): container finished" podID="346b3c1e-cd99-4b06-a096-6948b931916a" containerID="d8443e2f061febfcd761f4b2e389808466c3a34ba43665d2b48697583c18baa2" exitCode=0
Jun 10 10:44:47.036144 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:47.036119    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerDied","Data":"d8443e2f061febfcd761f4b2e389808466c3a34ba43665d2b48697583c18baa2"}
Jun 10 10:44:48.044393 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:48.044298    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerStarted","Data":"56d02f16654a3c3389826014c83bbd620e9787b01bc6f00565f4467d0189390e"}
Jun 10 10:44:48.044393 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:48.044367    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerStarted","Data":"bb916310ed7518a88b9a4f262aee2d60de8ed141355dbdb3223f68595c9e6503"}
Jun 10 10:44:48.044393 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:48.044389    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerStarted","Data":"7910978ecd4bc62794ca3e95ccb2e82c6704535f76cf936fa66226b22f956744"}
Jun 10 10:44:48.072506 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:48.072442    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podStartSLOduration=14.072418924 podStartE2EDuration="14.072418924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:44:48.070721075 +0000 UTC m=+1575.927657510" watchObservedRunningTime="2026-06-10 10:44:48.072418924 +0000 UTC m=+1575.929355356"
Jun 10 10:44:50.455925 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:50.455869    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:50.456524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:50.456495    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:50.456524 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:50.456527    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:50.457758 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:50.457720    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.37:8816: connect: connection refused"
Jun 10 10:44:50.457854 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:50.457769    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jun 10 10:44:50.457854 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:50.457779    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jun 10 10:44:53.456832 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.456798    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:53.457267 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.456956    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:53.457339 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.457322    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:53.457450 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.457361    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:53.457589 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.457570    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:53.457728 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.457711    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:53.460788 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:53.460774    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:54.075890 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:54.075862    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:44:54.078972 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:44:54.078949    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:45:55.405478 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.405446    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"]
Jun 10 10:45:55.406040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.405696    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online" containerID="cri-o://7910978ecd4bc62794ca3e95ccb2e82c6704535f76cf936fa66226b22f956744" gracePeriod=30
Jun 10 10:45:55.406040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.405728    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="offline" containerID="cri-o://bb916310ed7518a88b9a4f262aee2d60de8ed141355dbdb3223f68595c9e6503" gracePeriod=30
Jun 10 10:45:55.406040 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.405729    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui" containerID="cri-o://56d02f16654a3c3389826014c83bbd620e9787b01bc6f00565f4467d0189390e" gracePeriod=30
Jun 10 10:45:55.563968 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.563934    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"]
Jun 10 10:45:55.564511 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.564227    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="registry" containerID="cri-o://2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822" gracePeriod=30
Jun 10 10:45:55.564511 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.564291    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui" containerID="cri-o://c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29" gracePeriod=30
Jun 10 10:45:55.564511 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.564299    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online" containerID="cri-o://94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1" gracePeriod=30
Jun 10 10:45:55.564511 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:55.564254    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="offline" containerID="cri-o://f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77" gracePeriod=30
Jun 10 10:45:56.337292 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.337258    2552 generic.go:356] "Generic (PLEG): container finished" podID="346b3c1e-cd99-4b06-a096-6948b931916a" containerID="56d02f16654a3c3389826014c83bbd620e9787b01bc6f00565f4467d0189390e" exitCode=0
Jun 10 10:45:56.337292 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.337290    2552 generic.go:356] "Generic (PLEG): container finished" podID="346b3c1e-cd99-4b06-a096-6948b931916a" containerID="7910978ecd4bc62794ca3e95ccb2e82c6704535f76cf936fa66226b22f956744" exitCode=0
Jun 10 10:45:56.337518 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.337331    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerDied","Data":"56d02f16654a3c3389826014c83bbd620e9787b01bc6f00565f4467d0189390e"}
Jun 10 10:45:56.337518 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.337370    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerDied","Data":"7910978ecd4bc62794ca3e95ccb2e82c6704535f76cf936fa66226b22f956744"}
Jun 10 10:45:56.340241 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.340218    2552 generic.go:356] "Generic (PLEG): container finished" podID="1644133d-2818-4349-a26b-825e3449ceb5" containerID="c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29" exitCode=0
Jun 10 10:45:56.340241 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.340240    2552 generic.go:356] "Generic (PLEG): container finished" podID="1644133d-2818-4349-a26b-825e3449ceb5" containerID="94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1" exitCode=0
Jun 10 10:45:56.340389 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.340257    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"}
Jun 10 10:45:56.340389 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:45:56.340283    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"}
Jun 10 10:46:01.890394 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:01.890342    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jun 10 10:46:02.710098 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:02.710058    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jun 10 10:46:03.457623 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:03.457578    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jun 10 10:46:04.076238 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:04.076195    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jun 10 10:46:11.890484 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:11.890430    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jun 10 10:46:12.709514 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:12.709468    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jun 10 10:46:13.458236 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:13.458187    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jun 10 10:46:14.076517 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:14.076470    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jun 10 10:46:21.890482 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:21.890422    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jun 10 10:46:21.891048 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:21.890563    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:46:22.709508 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:22.709461    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jun 10 10:46:22.709703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:22.709573    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:46:23.457872 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:23.457826    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jun 10 10:46:23.458377 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:23.457977    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:46:24.076535 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:24.076490    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jun 10 10:46:24.076705 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:24.076629    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:46:25.463080 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:25.463050    2552 generic.go:356] "Generic (PLEG): container finished" podID="346b3c1e-cd99-4b06-a096-6948b931916a" containerID="bb916310ed7518a88b9a4f262aee2d60de8ed141355dbdb3223f68595c9e6503" exitCode=137
Jun 10 10:46:25.463439 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:25.463118    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerDied","Data":"bb916310ed7518a88b9a4f262aee2d60de8ed141355dbdb3223f68595c9e6503"}
Jun 10 10:46:26.060193 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.060167    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:46:26.199595 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.199571    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:46:26.207135 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207116    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls\") pod \"346b3c1e-cd99-4b06-a096-6948b931916a\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") "
Jun 10 10:46:26.207251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207149    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-online-tls\") pod \"346b3c1e-cd99-4b06-a096-6948b931916a\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") "
Jun 10 10:46:26.207251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207169    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/346b3c1e-cd99-4b06-a096-6948b931916a-registry-tls\") pod \"346b3c1e-cd99-4b06-a096-6948b931916a\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") "
Jun 10 10:46:26.207251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207204    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/346b3c1e-cd99-4b06-a096-6948b931916a-feast-data\") pod \"346b3c1e-cd99-4b06-a096-6948b931916a\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") "
Jun 10 10:46:26.207251 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207238    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdwrm\" (UniqueName: \"kubernetes.io/projected/346b3c1e-cd99-4b06-a096-6948b931916a-kube-api-access-zdwrm\") pod \"346b3c1e-cd99-4b06-a096-6948b931916a\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") "
Jun 10 10:46:26.207447 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207288    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-offline-tls\") pod \"346b3c1e-cd99-4b06-a096-6948b931916a\" (UID: \"346b3c1e-cd99-4b06-a096-6948b931916a\") "
Jun 10 10:46:26.207535 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207509    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/346b3c1e-cd99-4b06-a096-6948b931916a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "346b3c1e-cd99-4b06-a096-6948b931916a" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 10:46:26.207670 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.207648    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346b3c1e-cd99-4b06-a096-6948b931916a-feast-data" (OuterVolumeSpecName: "feast-data") pod "346b3c1e-cd99-4b06-a096-6948b931916a" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:46:26.209325 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.209286    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "346b3c1e-cd99-4b06-a096-6948b931916a" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.209431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.209344    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-online-tls" (OuterVolumeSpecName: "online-tls") pod "346b3c1e-cd99-4b06-a096-6948b931916a" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.209431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.209377    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346b3c1e-cd99-4b06-a096-6948b931916a-kube-api-access-zdwrm" (OuterVolumeSpecName: "kube-api-access-zdwrm") pod "346b3c1e-cd99-4b06-a096-6948b931916a" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a"). InnerVolumeSpecName "kube-api-access-zdwrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:46:26.209431 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.209373    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "346b3c1e-cd99-4b06-a096-6948b931916a" (UID: "346b3c1e-cd99-4b06-a096-6948b931916a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.307829 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.307803    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-registry-tls\") pod \"1644133d-2818-4349-a26b-825e3449ceb5\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") "
Jun 10 10:46:26.308027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.307837    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1644133d-2818-4349-a26b-825e3449ceb5-feast-data\") pod \"1644133d-2818-4349-a26b-825e3449ceb5\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") "
Jun 10 10:46:26.308027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.307879    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls\") pod \"1644133d-2818-4349-a26b-825e3449ceb5\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") "
Jun 10 10:46:26.308027 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.307925    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls\") pod \"1644133d-2818-4349-a26b-825e3449ceb5\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") "
Jun 10 10:46:26.308200 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308086    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbhcg\" (UniqueName: \"kubernetes.io/projected/1644133d-2818-4349-a26b-825e3449ceb5-kube-api-access-fbhcg\") pod \"1644133d-2818-4349-a26b-825e3449ceb5\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") "
Jun 10 10:46:26.308200 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308125    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-offline-tls\") pod \"1644133d-2818-4349-a26b-825e3449ceb5\" (UID: \"1644133d-2818-4349-a26b-825e3449ceb5\") "
Jun 10 10:46:26.308446 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308419    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.308582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308449    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.308582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308464    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/346b3c1e-cd99-4b06-a096-6948b931916a-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.308582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308476    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/346b3c1e-cd99-4b06-a096-6948b931916a-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.308582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308474    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1644133d-2818-4349-a26b-825e3449ceb5-feast-data" (OuterVolumeSpecName: "feast-data") pod "1644133d-2818-4349-a26b-825e3449ceb5" (UID: "1644133d-2818-4349-a26b-825e3449ceb5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:46:26.308582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308490    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/346b3c1e-cd99-4b06-a096-6948b931916a-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.308582 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.308531    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdwrm\" (UniqueName: \"kubernetes.io/projected/346b3c1e-cd99-4b06-a096-6948b931916a-kube-api-access-zdwrm\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.309973 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.309950    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls" (OuterVolumeSpecName: "online-tls") pod "1644133d-2818-4349-a26b-825e3449ceb5" (UID: "1644133d-2818-4349-a26b-825e3449ceb5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.310115 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.310080    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1644133d-2818-4349-a26b-825e3449ceb5" (UID: "1644133d-2818-4349-a26b-825e3449ceb5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.310208 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.310130    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1644133d-2818-4349-a26b-825e3449ceb5" (UID: "1644133d-2818-4349-a26b-825e3449ceb5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.310343 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.310325    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1644133d-2818-4349-a26b-825e3449ceb5" (UID: "1644133d-2818-4349-a26b-825e3449ceb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 10:46:26.310423 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.310406    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1644133d-2818-4349-a26b-825e3449ceb5-kube-api-access-fbhcg" (OuterVolumeSpecName: "kube-api-access-fbhcg") pod "1644133d-2818-4349-a26b-825e3449ceb5" (UID: "1644133d-2818-4349-a26b-825e3449ceb5"). InnerVolumeSpecName "kube-api-access-fbhcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:46:26.409368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.409334    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.409368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.409359    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1644133d-2818-4349-a26b-825e3449ceb5-feast-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.409368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.409368    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-ui-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.409368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.409377    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-online-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.409627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.409385    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbhcg\" (UniqueName: \"kubernetes.io/projected/1644133d-2818-4349-a26b-825e3449ceb5-kube-api-access-fbhcg\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.409627 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.409394    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1644133d-2818-4349-a26b-825e3449ceb5-offline-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:46:26.470258 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.470162    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"
Jun 10 10:46:26.470258 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.470176    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq" event={"ID":"346b3c1e-cd99-4b06-a096-6948b931916a","Type":"ContainerDied","Data":"32450bf9cf6d06522ea8cf6d6663ae8f27cd820388a3719c5b24d80c06a1f363"}
Jun 10 10:46:26.470258 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.470234    2552 scope.go:117] "RemoveContainer" containerID="56d02f16654a3c3389826014c83bbd620e9787b01bc6f00565f4467d0189390e"
Jun 10 10:46:26.473451 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.473426    2552 generic.go:356] "Generic (PLEG): container finished" podID="1644133d-2818-4349-a26b-825e3449ceb5" containerID="f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77" exitCode=137
Jun 10 10:46:26.473451 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.473451    2552 generic.go:356] "Generic (PLEG): container finished" podID="1644133d-2818-4349-a26b-825e3449ceb5" containerID="2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822" exitCode=137
Jun 10 10:46:26.473587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.473482    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"}
Jun 10 10:46:26.473587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.473524    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"}
Jun 10 10:46:26.473587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.473547    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln" event={"ID":"1644133d-2818-4349-a26b-825e3449ceb5","Type":"ContainerDied","Data":"d741464a46273dd6eb8d3a3f84770d042eb5c66ef58f420b5d4f23f2ea5fe8f2"}
Jun 10 10:46:26.473587 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.473484    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"
Jun 10 10:46:26.480239 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.480223    2552 scope.go:117] "RemoveContainer" containerID="bb916310ed7518a88b9a4f262aee2d60de8ed141355dbdb3223f68595c9e6503"
Jun 10 10:46:26.493651 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.493632    2552 scope.go:117] "RemoveContainer" containerID="7910978ecd4bc62794ca3e95ccb2e82c6704535f76cf936fa66226b22f956744"
Jun 10 10:46:26.501195 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.501173    2552 scope.go:117] "RemoveContainer" containerID="d8443e2f061febfcd761f4b2e389808466c3a34ba43665d2b48697583c18baa2"
Jun 10 10:46:26.505396 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.505374    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"]
Jun 10 10:46:26.508527 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.508511    2552 scope.go:117] "RemoveContainer" containerID="45cb38e529cbf2b056e89e479a7d77b8f9e32b9af466d3f63d2bfda14388e791"
Jun 10 10:46:26.515967 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.515946    2552 scope.go:117] "RemoveContainer" containerID="c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"
Jun 10 10:46:26.517553 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.517526    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-bbxkq"]
Jun 10 10:46:26.523625 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.523607    2552 scope.go:117] "RemoveContainer" containerID="f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"
Jun 10 10:46:26.530863 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.530837    2552 scope.go:117] "RemoveContainer" containerID="94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"
Jun 10 10:46:26.538544 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.538525    2552 scope.go:117] "RemoveContainer" containerID="2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"
Jun 10 10:46:26.545858 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.545838    2552 scope.go:117] "RemoveContainer" containerID="7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"
Jun 10 10:46:26.552808 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.552793    2552 scope.go:117] "RemoveContainer" containerID="daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"
Jun 10 10:46:26.556345 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.556326    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"]
Jun 10 10:46:26.560343 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.560325    2552 scope.go:117] "RemoveContainer" containerID="c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"
Jun 10 10:46:26.560571 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:46:26.560552    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29\": container with ID starting with c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29 not found: ID does not exist" containerID="c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"
Jun 10 10:46:26.560629 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.560580    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"} err="failed to get container status \"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29\": rpc error: code = NotFound desc = could not find container \"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29\": container with ID starting with c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29 not found: ID does not exist"
Jun 10 10:46:26.560629 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.560599    2552 scope.go:117] "RemoveContainer" containerID="f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"
Jun 10 10:46:26.560862 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:46:26.560845    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77\": container with ID starting with f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77 not found: ID does not exist" containerID="f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"
Jun 10 10:46:26.560954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.560868    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"} err="failed to get container status \"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77\": rpc error: code = NotFound desc = could not find container \"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77\": container with ID starting with f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77 not found: ID does not exist"
Jun 10 10:46:26.560954 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.560884    2552 scope.go:117] "RemoveContainer" containerID="94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"
Jun 10 10:46:26.561211 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:46:26.561177    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1\": container with ID starting with 94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1 not found: ID does not exist" containerID="94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"
Jun 10 10:46:26.561256 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.561219    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"} err="failed to get container status \"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1\": rpc error: code = NotFound desc = could not find container \"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1\": container with ID starting with 94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1 not found: ID does not exist"
Jun 10 10:46:26.561256 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.561241    2552 scope.go:117] "RemoveContainer" containerID="2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"
Jun 10 10:46:26.561496 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:46:26.561477    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822\": container with ID starting with 2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822 not found: ID does not exist" containerID="2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"
Jun 10 10:46:26.561538 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.561502    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"} err="failed to get container status \"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822\": rpc error: code = NotFound desc = could not find container \"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822\": container with ID starting with 2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822 not found: ID does not exist"
Jun 10 10:46:26.561538 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.561515    2552 scope.go:117] "RemoveContainer" containerID="7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"
Jun 10 10:46:26.561736 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:46:26.561719    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee\": container with ID starting with 7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee not found: ID does not exist" containerID="7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"
Jun 10 10:46:26.561783 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.561739    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"} err="failed to get container status \"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee\": rpc error: code = NotFound desc = could not find container \"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee\": container with ID starting with 7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee not found: ID does not exist"
Jun 10 10:46:26.561783 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.561753    2552 scope.go:117] "RemoveContainer" containerID="daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"
Jun 10 10:46:26.561997 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:46:26.561980    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac\": container with ID starting with daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac not found: ID does not exist" containerID="daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"
Jun 10 10:46:26.562063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562000    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"} err="failed to get container status \"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac\": rpc error: code = NotFound desc = could not find container \"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac\": container with ID starting with daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac not found: ID does not exist"
Jun 10 10:46:26.562063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562013    2552 scope.go:117] "RemoveContainer" containerID="c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"
Jun 10 10:46:26.562217 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562194    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29"} err="failed to get container status \"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29\": rpc error: code = NotFound desc = could not find container \"c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29\": container with ID starting with c906e48e1322e28f8e18e835de8581deb9318c2b4cba770a0924c64915203c29 not found: ID does not exist"
Jun 10 10:46:26.562278 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562218    2552 scope.go:117] "RemoveContainer" containerID="f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"
Jun 10 10:46:26.562436 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562417    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77"} err="failed to get container status \"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77\": rpc error: code = NotFound desc = could not find container \"f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77\": container with ID starting with f23b2826ad16f670ee50b04ccbf7fc5e208c7a26a2a8c054274060fff8d37c77 not found: ID does not exist"
Jun 10 10:46:26.562436 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562436    2552 scope.go:117] "RemoveContainer" containerID="94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"
Jun 10 10:46:26.562686 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562665    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1"} err="failed to get container status \"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1\": rpc error: code = NotFound desc = could not find container \"94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1\": container with ID starting with 94c51bca2feff1f2445c7fbc6fd15bb00321147484b857463235c7ebd94f24f1 not found: ID does not exist"
Jun 10 10:46:26.562759 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562688    2552 scope.go:117] "RemoveContainer" containerID="2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"
Jun 10 10:46:26.562899 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562883    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822"} err="failed to get container status \"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822\": rpc error: code = NotFound desc = could not find container \"2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822\": container with ID starting with 2bd3c4d0e7ca27069c3644f11c331a2b1e22e354e8b3facfd1f09e31e7353822 not found: ID does not exist"
Jun 10 10:46:26.562969 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.562899    2552 scope.go:117] "RemoveContainer" containerID="7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"
Jun 10 10:46:26.563156 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.563137    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee"} err="failed to get container status \"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee\": rpc error: code = NotFound desc = could not find container \"7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee\": container with ID starting with 7506eb0250da1a3376730a385c03f0871bbb4b0182146bb46c33252d0d0bfbee not found: ID does not exist"
Jun 10 10:46:26.563226 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.563159    2552 scope.go:117] "RemoveContainer" containerID="daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"
Jun 10 10:46:26.563423 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.563400    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac"} err="failed to get container status \"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac\": rpc error: code = NotFound desc = could not find container \"daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac\": container with ID starting with daa9003badf9b3ea6aa1d94b352f1b14f2cc30c7cb619cf4a175050fb70721ac not found: ID does not exist"
Jun 10 10:46:26.565485 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.565466    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpwln"]
Jun 10 10:46:26.578988 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.578964    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1644133d-2818-4349-a26b-825e3449ceb5" path="/var/lib/kubelet/pods/1644133d-2818-4349-a26b-825e3449ceb5/volumes"
Jun 10 10:46:26.579652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:26.579633    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" path="/var/lib/kubelet/pods/346b3c1e-cd99-4b06-a096-6948b931916a/volumes"
Jun 10 10:46:45.265703 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.265669    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mpwx5/must-gather-87b2b"]
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266023    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="feast-apply"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266039    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="feast-apply"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266050    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266056    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266071    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="offline"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266079    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="offline"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266085    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="feast-init"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266091    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="feast-init"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266098    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="offline"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266103    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="offline"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266110    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="registry"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266116    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="registry"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266126    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266131    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266138    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266143    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266148    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="feast-apply"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266152    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="feast-apply"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266158    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266163    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266171    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="feast-init"
Jun 10 10:46:45.266199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266176    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="feast-init"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266229    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="ui"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266236    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="offline"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266243    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="online"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266261    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="ui"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266267    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="offline"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266275    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="346b3c1e-cd99-4b06-a096-6948b931916a" containerName="online"
Jun 10 10:46:45.266869 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.266281    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1644133d-2818-4349-a26b-825e3449ceb5" containerName="registry"
Jun 10 10:46:45.270680 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.270662    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.276142 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.276118    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mpwx5\"/\"kube-root-ca.crt\""
Jun 10 10:46:45.276282 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.276127    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mpwx5\"/\"openshift-service-ca.crt\""
Jun 10 10:46:45.276282 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.276173    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mpwx5\"/\"default-dockercfg-w6ccf\""
Jun 10 10:46:45.281138 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.281114    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mpwx5/must-gather-87b2b"]
Jun 10 10:46:45.376752 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.376714    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6mx\" (UniqueName: \"kubernetes.io/projected/28d574f0-1895-4136-a90a-4dfb2906bbd0-kube-api-access-sv6mx\") pod \"must-gather-87b2b\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") " pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.376955 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.376761    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28d574f0-1895-4136-a90a-4dfb2906bbd0-must-gather-output\") pod \"must-gather-87b2b\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") " pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.477810 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.477756    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6mx\" (UniqueName: \"kubernetes.io/projected/28d574f0-1895-4136-a90a-4dfb2906bbd0-kube-api-access-sv6mx\") pod \"must-gather-87b2b\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") " pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.478023 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.477825    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28d574f0-1895-4136-a90a-4dfb2906bbd0-must-gather-output\") pod \"must-gather-87b2b\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") " pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.478199 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.478179    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28d574f0-1895-4136-a90a-4dfb2906bbd0-must-gather-output\") pod \"must-gather-87b2b\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") " pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.486691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.486660    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6mx\" (UniqueName: \"kubernetes.io/projected/28d574f0-1895-4136-a90a-4dfb2906bbd0-kube-api-access-sv6mx\") pod \"must-gather-87b2b\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") " pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.587522 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.587442    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:46:45.717185 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.717158    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mpwx5/must-gather-87b2b"]
Jun 10 10:46:45.719719 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:46:45.719693    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28d574f0_1895_4136_a90a_4dfb2906bbd0.slice/crio-3d3d1d4da9601307abe8d21f9bf117311fe6a7d282f2c17fc434653549e598db WatchSource:0}: Error finding container 3d3d1d4da9601307abe8d21f9bf117311fe6a7d282f2c17fc434653549e598db: Status 404 returned error can't find the container with id 3d3d1d4da9601307abe8d21f9bf117311fe6a7d282f2c17fc434653549e598db
Jun 10 10:46:45.721384 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:45.721366    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 10:46:46.560850 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:46.560780    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpwx5/must-gather-87b2b" event={"ID":"28d574f0-1895-4136-a90a-4dfb2906bbd0","Type":"ContainerStarted","Data":"3d3d1d4da9601307abe8d21f9bf117311fe6a7d282f2c17fc434653549e598db"}
Jun 10 10:46:52.599078 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:52.599033    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpwx5/must-gather-87b2b" event={"ID":"28d574f0-1895-4136-a90a-4dfb2906bbd0","Type":"ContainerStarted","Data":"d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015"}
Jun 10 10:46:52.599078 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:52.599080    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpwx5/must-gather-87b2b" event={"ID":"28d574f0-1895-4136-a90a-4dfb2906bbd0","Type":"ContainerStarted","Data":"2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"}
Jun 10 10:46:52.626066 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:46:52.626008    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mpwx5/must-gather-87b2b" podStartSLOduration=1.6311132640000001 podStartE2EDuration="7.625992922s" totalImagesPullingTime="5.994879658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 10:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:46:52.625622439 +0000 UTC m=+1700.482558882" watchObservedRunningTime="2026-06-10 10:46:52.625992922 +0000 UTC m=+1700.482929352"
Jun 10 10:47:01.635853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:01.635813    2552 generic.go:356] "Generic (PLEG): container finished" podID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerID="2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36" exitCode=0
Jun 10 10:47:01.635853 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:01.635856    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpwx5/must-gather-87b2b" event={"ID":"28d574f0-1895-4136-a90a-4dfb2906bbd0","Type":"ContainerDied","Data":"2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"}
Jun 10 10:47:01.636321 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:01.636192    2552 scope.go:117] "RemoveContainer" containerID="2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"
Jun 10 10:47:02.588375 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:02.588342    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mpwx5_must-gather-87b2b_28d574f0-1895-4136-a90a-4dfb2906bbd0/gather/0.log"
Jun 10 10:47:06.225000 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:06.224971    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cs4zm_5ef86f68-d30d-4000-97d6-29d744549b05/global-pull-secret-syncer/0.log"
Jun 10 10:47:06.387135 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:06.387103    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-plv8g_0129c785-2601-4ed8-832d-abe84428173b/konnectivity-agent/0.log"
Jun 10 10:47:06.451297 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:06.451270    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-245.ec2.internal_0cfd7fd91bf7b2135b4a972f86e20b51/haproxy/0.log"
Jun 10 10:47:08.089613 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.089582    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-mpwx5/must-gather-87b2b"]
Jun 10 10:47:08.090165 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.089745    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-mpwx5/must-gather-87b2b" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="copy" containerID="cri-o://d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015" gracePeriod=2
Jun 10 10:47:08.101385 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.101353    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-mpwx5/must-gather-87b2b"]
Jun 10 10:47:08.323556 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.323533    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mpwx5_must-gather-87b2b_28d574f0-1895-4136-a90a-4dfb2906bbd0/copy/0.log"
Jun 10 10:47:08.324877 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.324860    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:47:08.333524 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:47:08.333498    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-87b2b\" is forbidden: User \"system:node:ip-10-0-136-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mpwx5\": no relationship found between node 'ip-10-0-136-245.ec2.internal' and this object" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:47:08.489378 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.489345    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv6mx\" (UniqueName: \"kubernetes.io/projected/28d574f0-1895-4136-a90a-4dfb2906bbd0-kube-api-access-sv6mx\") pod \"28d574f0-1895-4136-a90a-4dfb2906bbd0\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") "
Jun 10 10:47:08.489597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.489424    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28d574f0-1895-4136-a90a-4dfb2906bbd0-must-gather-output\") pod \"28d574f0-1895-4136-a90a-4dfb2906bbd0\" (UID: \"28d574f0-1895-4136-a90a-4dfb2906bbd0\") "
Jun 10 10:47:08.489823 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.489796    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28d574f0-1895-4136-a90a-4dfb2906bbd0-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "28d574f0-1895-4136-a90a-4dfb2906bbd0" (UID: "28d574f0-1895-4136-a90a-4dfb2906bbd0"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 10:47:08.491533 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.491509    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28d574f0-1895-4136-a90a-4dfb2906bbd0-kube-api-access-sv6mx" (OuterVolumeSpecName: "kube-api-access-sv6mx") pod "28d574f0-1895-4136-a90a-4dfb2906bbd0" (UID: "28d574f0-1895-4136-a90a-4dfb2906bbd0"). InnerVolumeSpecName "kube-api-access-sv6mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 10:47:08.579473 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.579439    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" path="/var/lib/kubelet/pods/28d574f0-1895-4136-a90a-4dfb2906bbd0/volumes"
Jun 10 10:47:08.590449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.590425    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv6mx\" (UniqueName: \"kubernetes.io/projected/28d574f0-1895-4136-a90a-4dfb2906bbd0-kube-api-access-sv6mx\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:47:08.590449 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.590447    2552 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28d574f0-1895-4136-a90a-4dfb2906bbd0-must-gather-output\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\""
Jun 10 10:47:08.664773 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.664744    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mpwx5_must-gather-87b2b_28d574f0-1895-4136-a90a-4dfb2906bbd0/copy/0.log"
Jun 10 10:47:08.665120 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.665098    2552 generic.go:356] "Generic (PLEG): container finished" podID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerID="d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015" exitCode=143
Jun 10 10:47:08.665193 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.665140    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpwx5/must-gather-87b2b"
Jun 10 10:47:08.665193 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.665177    2552 scope.go:117] "RemoveContainer" containerID="d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015"
Jun 10 10:47:08.673230 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.673202    2552 scope.go:117] "RemoveContainer" containerID="2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"
Jun 10 10:47:08.685062 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.685039    2552 scope.go:117] "RemoveContainer" containerID="d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015"
Jun 10 10:47:08.685313 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:47:08.685294    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015\": container with ID starting with d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015 not found: ID does not exist" containerID="d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015"
Jun 10 10:47:08.685358 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.685322    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015"} err="failed to get container status \"d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015\": rpc error: code = NotFound desc = could not find container \"d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015\": container with ID starting with d29c332758a5563dd8f5de195e64e44d822bbaf202b687dfe283b755a4c94015 not found: ID does not exist"
Jun 10 10:47:08.685358 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.685339    2552 scope.go:117] "RemoveContainer" containerID="2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"
Jun 10 10:47:08.685580 ip-10-0-136-245 kubenswrapper[2552]: E0610 10:47:08.685559    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36\": container with ID starting with 2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36 not found: ID does not exist" containerID="2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"
Jun 10 10:47:08.685621 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:08.685587    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36"} err="failed to get container status \"2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36\": rpc error: code = NotFound desc = could not find container \"2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36\": container with ID starting with 2abdf73d0e7d201762e592a28695f362cf4c64de89a6f9a5e7471b085b4e4f36 not found: ID does not exist"
Jun 10 10:47:09.825824 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:09.825797    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/alertmanager/0.log"
Jun 10 10:47:09.941042 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:09.941008    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/config-reloader/0.log"
Jun 10 10:47:10.022646 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.022619    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/kube-rbac-proxy-web/0.log"
Jun 10 10:47:10.121050 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.121019    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/kube-rbac-proxy/0.log"
Jun 10 10:47:10.195171 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.195142    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/kube-rbac-proxy-metric/0.log"
Jun 10 10:47:10.239803 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.239780    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/prom-label-proxy/0.log"
Jun 10 10:47:10.289761 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.289737    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b81f4e83-c35a-4055-aa9c-ab225281e2e5/init-config-reloader/0.log"
Jun 10 10:47:10.388423 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.388346    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-4wwpj_87a28841-bbee-4ed1-84c1-cffd862a9349/kube-state-metrics/0.log"
Jun 10 10:47:10.428827 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.428800    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-4wwpj_87a28841-bbee-4ed1-84c1-cffd862a9349/kube-rbac-proxy-main/0.log"
Jun 10 10:47:10.476997 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.476971    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-4wwpj_87a28841-bbee-4ed1-84c1-cffd862a9349/kube-rbac-proxy-self/0.log"
Jun 10 10:47:10.536847 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.536822    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-666d474d9c-94865_9c8c36d4-47e7-4cff-bd4f-fd7b1e7fca65/metrics-server/0.log"
Jun 10 10:47:10.585921 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.585883    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-895wr_9730812f-c11a-463f-8eac-37dc47820be5/monitoring-plugin/0.log"
Jun 10 10:47:10.631442 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.631415    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wsx8_7df52090-d79c-412b-b68e-f6c08ac097a7/node-exporter/0.log"
Jun 10 10:47:10.691470 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.691396    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wsx8_7df52090-d79c-412b-b68e-f6c08ac097a7/kube-rbac-proxy/0.log"
Jun 10 10:47:10.726516 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:10.726490    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wsx8_7df52090-d79c-412b-b68e-f6c08ac097a7/init-textfile/0.log"
Jun 10 10:47:11.034701 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.034671    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fggd2_8f4955e0-9723-494d-bd37-2f97c08ad7f0/kube-rbac-proxy-main/0.log"
Jun 10 10:47:11.069111 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.069087    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fggd2_8f4955e0-9723-494d-bd37-2f97c08ad7f0/kube-rbac-proxy-self/0.log"
Jun 10 10:47:11.101633 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.101607    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fggd2_8f4955e0-9723-494d-bd37-2f97c08ad7f0/openshift-state-metrics/0.log"
Jun 10 10:47:11.165691 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.165660    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/prometheus/0.log"
Jun 10 10:47:11.204839 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.204815    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/config-reloader/0.log"
Jun 10 10:47:11.235922 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.235840    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/thanos-sidecar/0.log"
Jun 10 10:47:11.266723 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.266689    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/kube-rbac-proxy-web/0.log"
Jun 10 10:47:11.297648 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.297618    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/kube-rbac-proxy/0.log"
Jun 10 10:47:11.335189 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.335156    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/kube-rbac-proxy-thanos/0.log"
Jun 10 10:47:11.365354 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.365330    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89173a1b-a940-437f-9e98-74b7b0a9a332/init-config-reloader/0.log"
Jun 10 10:47:11.402008 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.401988    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-4jm8b_c7ccb29e-bc92-42eb-af69-751f7578fbe8/prometheus-operator/0.log"
Jun 10 10:47:11.436096 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.436069    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-4jm8b_c7ccb29e-bc92-42eb-af69-751f7578fbe8/kube-rbac-proxy/0.log"
Jun 10 10:47:11.514826 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.514748    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68b768f76-crcl6_4d9ff042-496e-485d-a790-201bdc8b0389/telemeter-client/0.log"
Jun 10 10:47:11.547248 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.547227    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68b768f76-crcl6_4d9ff042-496e-485d-a790-201bdc8b0389/reload/0.log"
Jun 10 10:47:11.594156 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.594124    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68b768f76-crcl6_4d9ff042-496e-485d-a790-201bdc8b0389/kube-rbac-proxy/0.log"
Jun 10 10:47:11.671619 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.671591    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665698bb98-fth7s_96bace15-efa3-44e9-876a-3eeee447f7c8/thanos-query/0.log"
Jun 10 10:47:11.742880 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.742846    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665698bb98-fth7s_96bace15-efa3-44e9-876a-3eeee447f7c8/kube-rbac-proxy-web/0.log"
Jun 10 10:47:11.795271 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.795177    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665698bb98-fth7s_96bace15-efa3-44e9-876a-3eeee447f7c8/kube-rbac-proxy/0.log"
Jun 10 10:47:11.852537 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.852505    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665698bb98-fth7s_96bace15-efa3-44e9-876a-3eeee447f7c8/prom-label-proxy/0.log"
Jun 10 10:47:11.901275 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.901251    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665698bb98-fth7s_96bace15-efa3-44e9-876a-3eeee447f7c8/kube-rbac-proxy-rules/0.log"
Jun 10 10:47:11.947928 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:11.947885    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665698bb98-fth7s_96bace15-efa3-44e9-876a-3eeee447f7c8/kube-rbac-proxy-metrics/0.log"
Jun 10 10:47:13.462273 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462235    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"]
Jun 10 10:47:13.462754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462556    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="gather"
Jun 10 10:47:13.462754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462567    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="gather"
Jun 10 10:47:13.462754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462590    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="copy"
Jun 10 10:47:13.462754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462596    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="copy"
Jun 10 10:47:13.462754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462662    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="gather"
Jun 10 10:47:13.462754 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.462671    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d574f0-1895-4136-a90a-4dfb2906bbd0" containerName="copy"
Jun 10 10:47:13.467456 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.467439    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.470388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.470366    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q92hd\"/\"kube-root-ca.crt\""
Jun 10 10:47:13.470901 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.470883    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q92hd\"/\"default-dockercfg-4gww4\""
Jun 10 10:47:13.471023 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.470929    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q92hd\"/\"openshift-service-ca.crt\""
Jun 10 10:47:13.477252 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.477229    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"]
Jun 10 10:47:13.530157 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.530123    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9flbf\" (UniqueName: \"kubernetes.io/projected/b792976d-a5b1-404b-a7e4-b2e69cefea87-kube-api-access-9flbf\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.530320 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.530180    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-podres\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.530320 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.530201    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-lib-modules\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.530320 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.530224    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-sys\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.530442 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.530318    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-proc\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631226 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631185    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-proc\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631415 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631268    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9flbf\" (UniqueName: \"kubernetes.io/projected/b792976d-a5b1-404b-a7e4-b2e69cefea87-kube-api-access-9flbf\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631415 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631346    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-proc\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631415 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631407    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-podres\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631447    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-lib-modules\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631516    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-sys\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631542    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-podres\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631559    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-sys\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.631597 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.631586    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b792976d-a5b1-404b-a7e4-b2e69cefea87-lib-modules\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.640862 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.640836    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9flbf\" (UniqueName: \"kubernetes.io/projected/b792976d-a5b1-404b-a7e4-b2e69cefea87-kube-api-access-9flbf\") pod \"perf-node-gather-daemonset-xgq4g\" (UID: \"b792976d-a5b1-404b-a7e4-b2e69cefea87\") " pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.777411 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.777324    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:13.904072 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:13.904052    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"]
Jun 10 10:47:13.906388 ip-10-0-136-245 kubenswrapper[2552]: W0610 10:47:13.906363    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb792976d_a5b1_404b_a7e4_b2e69cefea87.slice/crio-7834a89051e0fab98224d1f79b45887d7fd34178a935254a72cc33b0ee7a3ece WatchSource:0}: Error finding container 7834a89051e0fab98224d1f79b45887d7fd34178a935254a72cc33b0ee7a3ece: Status 404 returned error can't find the container with id 7834a89051e0fab98224d1f79b45887d7fd34178a935254a72cc33b0ee7a3ece
Jun 10 10:47:14.027208 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:14.027184    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-5xd68_71657fc6-205f-46c9-b110-4564cd3fc7db/download-server/0.log"
Jun 10 10:47:14.696779 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:14.696745    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g" event={"ID":"b792976d-a5b1-404b-a7e4-b2e69cefea87","Type":"ContainerStarted","Data":"eaa8d35341f02fd5bd16a11e81ac5c36d47ca30b24ba6b43ca31d625882e6ee3"}
Jun 10 10:47:14.697180 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:14.696798    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g" event={"ID":"b792976d-a5b1-404b-a7e4-b2e69cefea87","Type":"ContainerStarted","Data":"7834a89051e0fab98224d1f79b45887d7fd34178a935254a72cc33b0ee7a3ece"}
Jun 10 10:47:14.697180 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:14.696839    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:14.728388 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:14.728334    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g" podStartSLOduration=1.728315145 podStartE2EDuration="1.728315145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 10:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 10:47:14.728266878 +0000 UTC m=+1722.585203310" watchObservedRunningTime="2026-06-10 10:47:14.728315145 +0000 UTC m=+1722.585251588"
Jun 10 10:47:15.407478 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:15.407451    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9sbd_adec1928-0d05-4ff0-9d28-a26b633eb25f/dns/0.log"
Jun 10 10:47:15.432510 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:15.432483    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9sbd_adec1928-0d05-4ff0-9d28-a26b633eb25f/kube-rbac-proxy/0.log"
Jun 10 10:47:15.520368 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:15.520345    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hdhd4_2d767806-21d0-4933-bb3f-3671141887ef/dns-node-resolver/0.log"
Jun 10 10:47:16.136111 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:16.136083    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ssp29_5a4ec284-9d48-4a2e-9f6c-72dd62a729d4/node-ca/0.log"
Jun 10 10:47:17.653651 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:17.653620    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wflhq_3730d957-6932-417e-bc01-546db8a637bf/serve-healthcheck-canary/0.log"
Jun 10 10:47:18.400781 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:18.400754    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vrp7k_1cc7e4ce-bceb-432b-a386-749992dc64d8/kube-rbac-proxy/0.log"
Jun 10 10:47:18.426806 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:18.426778    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vrp7k_1cc7e4ce-bceb-432b-a386-749992dc64d8/exporter/0.log"
Jun 10 10:47:18.458302 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:18.458265    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vrp7k_1cc7e4ce-bceb-432b-a386-749992dc64d8/extractor/0.log"
Jun 10 10:47:20.710128 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:20.710100    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q92hd/perf-node-gather-daemonset-xgq4g"
Jun 10 10:47:24.808390 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.808306    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/kube-multus-additional-cni-plugins/0.log"
Jun 10 10:47:24.833769 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.833727    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/egress-router-binary-copy/0.log"
Jun 10 10:47:24.858714 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.858685    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/cni-plugins/0.log"
Jun 10 10:47:24.883096 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.883073    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/bond-cni-plugin/0.log"
Jun 10 10:47:24.909652 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.909621    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/routeoverride-cni/0.log"
Jun 10 10:47:24.938626 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.938599    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/whereabouts-cni-bincopy/0.log"
Jun 10 10:47:24.966140 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:24.966117    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlsr6_68f9c259-4579-47c8-a89d-c24fc5e6d461/whereabouts-cni/0.log"
Jun 10 10:47:25.426872 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:25.426846    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dxvnf_ef905838-a1f0-4025-a1cb-279428c11747/kube-multus/0.log"
Jun 10 10:47:25.543064 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:25.543038    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fznl8_76422cdb-4abe-4de3-a33f-49aafeeaa38c/network-metrics-daemon/0.log"
Jun 10 10:47:25.566063 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:25.566042    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fznl8_76422cdb-4abe-4de3-a33f-49aafeeaa38c/kube-rbac-proxy/0.log"
Jun 10 10:47:27.051355 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.051323    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/ovn-controller/0.log"
Jun 10 10:47:27.073300 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.073274    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/ovn-acl-logging/0.log"
Jun 10 10:47:27.099468 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.099439    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/kube-rbac-proxy-node/0.log"
Jun 10 10:47:27.120781 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.120758    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/kube-rbac-proxy-ovn-metrics/0.log"
Jun 10 10:47:27.142037 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.142003    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/northd/0.log"
Jun 10 10:47:27.169073 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.169054    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/nbdb/0.log"
Jun 10 10:47:27.196641 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.196618    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/sbdb/0.log"
Jun 10 10:47:27.243150 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:27.243125    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6lbv_2e30ff2c-3b5d-4515-b2a8-f60475fbf444/ovnkube-controller/0.log"
Jun 10 10:47:28.392885 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:28.392856    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jcnpv_5e32543a-b771-4347-86c9-a65ac22df508/network-check-target-container/0.log"
Jun 10 10:47:29.409052 ip-10-0-136-245 kubenswrapper[2552]: I0610 10:47:29.408977    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6qdrg_5a399149-f72c-48c1-8424-e31668063ce5/iptables-alerter/0.log"