Skip to content
Artwork for The Data Science Podcast with Fexingo: Analytics, Machine Learning, and Data-Driven Conversations
The Data Science Podcast with Fexingo: Analytics, Machine Learning, and Data-Driven Conversations · November 9 · 9 min

Why Your AI Models Fail on Simple Text

We talk about the hidden cost of tokenization in large language models and why a single character difference can derail revenue. Using a concrete example from financial reporting, we show how standard tokenizers break down on niche jargon and what data teams can do to fix it without retraining entire networks. #FexingoBusiness #BusinessPodcast #DataScience #MachineLearning #LargeLanguageModels #Tokenization #NLP #AIEngineering #LLMOptimization #FinancialTech #TextAnalytics #ModelPerformance #DataStrategy #ArtificialIntelligence #TechTrends #BusinessIntelligence #DataTeams #AlgorithmicEfficiency Keep every episode free: buymeacoffee.com/fexingo

0:00-9:35

transcript

No transcript — this publisher did not publish one.

show notes

We talk about the hidden cost of tokenization in large language models and why a single character difference can derail revenue. Using a concrete example from financial reporting, we show how standard tokenizers break down on niche jargon and what data teams can do to fix it without retraining entire networks.

#FexingoBusiness #BusinessPodcast #DataScience #MachineLearning #LargeLanguageModels #Tokenization #NLP #AIEngineering #LLMOptimization #FinancialTech #TextAnalytics #ModelPerformance #DataStrategy #ArtificialIntelligence #TechTrends #BusinessIntelligence #DataTeams #AlgorithmicEfficiency

Keep every episode free: buymeacoffee.com/fexingo

links1