Powered by LumidaWealth.com
Lumida News
  • Home
  • EarningsNEW
  • News
    • Alt Assets
    • Crypto
    • Equities
    • Macro
    • Markets
    • Real Estate
  • Lifestyle
    • Family Office
    • Health and Longevity
  • Themes
    • Aging & Longevity
    • AI
    • CRE
    • Digital Assets
    • Legacy Brands
    • Nuclear Renaissance
    • Private Credit
  • About Us
No Result
View All Result
Lumida News
  • Home
  • EarningsNEW
  • News
    • Alt Assets
    • Crypto
    • Equities
    • Macro
    • Markets
    • Real Estate
  • Lifestyle
    • Family Office
    • Health and Longevity
  • Themes
    • Aging & Longevity
    • AI
    • CRE
    • Digital Assets
    • Legacy Brands
    • Nuclear Renaissance
    • Private Credit
  • About Us
No Result
View All Result
Lumida News
No Result
View All Result
  • Lumida Wealth
  • Lumida Ledger
  • LUMIDA ETF
  • About Us
Home Themes AI

Why Tokens Are Sabotaging AI: The Hidden Flaw in Generative Models

by Team Lumida
July 7, 2024
in AI
Reading Time: 3 mins read
A A
0
Why Tokens Are Sabotaging AI: The Hidden Flaw in Generative Models
Share on TelegramShare on TwitterShare on FacebookShare on LinkedinShare on Whatsapp

Key Takeaways:

  1. Tokenization fragments text, leading to biases and inconsistencies in AI models.
  2. Non-English languages face greater inefficiencies due to tokenization, inflating costs and reducing performance.
  3. Future AI models like MambaByte could eliminate tokenization, improving accuracy and efficiency.

What Happened?

Generative AI models, including popular ones like OpenAI’s GPT-4o, rely on a process called tokenization to break down text into smaller pieces called tokens. This method helps these models handle large amounts of data but introduces significant limitations and biases.

For example, tokenizers can inconsistently break down words and phrases, leading to different outputs for seemingly similar inputs. Additionally, languages that don’t use spaces to separate words, like Chinese and Japanese, face even more challenges, causing these models to perform tasks slower and less accurately.

Why It Matters?

Tokenization issues impact the reliability and efficiency of generative AI models. Inconsistent tokenization can lead to significant errors, such as misinterpreting numbers or failing basic language tasks.

Non-English languages suffer more, as tokenization can increase the time and cost of using AI tools, creating inequities in AI performance globally. Understanding these limitations is crucial for investors looking at AI technologies because it highlights areas where current models fall short and where future innovations are needed.

What’s Next?

Researchers are exploring alternatives to tokenization, such as byte-level models like MambaByte, which can handle raw text data more efficiently. These models could potentially solve many of the issues caused by tokenization, offering a more accurate and cost-effective solution.

However, these innovations are still in the early stages of development. Investors should watch for breakthroughs in this area, as new model architectures could significantly enhance the capabilities and market potential of generative AI technologies.

Via: TechCrunch
Tags: generative AIOpenAITokenization
Previous Post

China’s Foreign Reserves Slip as Dollar Strengthens: What It Means for Investors

Next Post

Discounts on the Rise: How Consumer Frugality is Shaping Market Trends

Recommended For You

California Attorney General Rob Bonta Issues a Subpoena to Nvidia Over Whether Advanced Chips Reached China and Investors Were Misled

by Team Lumida
8 hours ago

California AG Rob Bonta issued an investigative subpoena to Nvidia on Thursday over whether advanced chips reached China and whether investors were misled.

Read more

U.S. Approved Nearly 880,000 AI Chip Sales to Chinese Firms Including Tencent and Alibaba, House Data Show

by Team Lumida
8 hours ago

House data show the U.S. approved nearly 880,000 AI chip sales to China, including shipments for Tencent and Alibaba, after Nvidia and AMD sought 3.4 million.

Read more

Anthropic Closes at $88.91, Down 8.5% on Its Second Day, After a Debut High Above $115, as the IPO Fails to Revive the AI Trade

by Team Lumida
9 hours ago

Anthropic fell 8.5% to $88.91 on its second session, giving back much of Thursday’s 17% debut gain, as valuation anxiety kept the AI trade under pressure.

Read more

Trump Says the US Could Let Nvidia Sell Blackwell Chips to China in ‘Two Years or Three Years,’ Calling the H200 ‘Semi-Obsolete’ as Congress Moves to Bar Sales for 18 Months

by Team Lumida
2 days ago

Trump said Nvidia could sell Blackwell chips to China in two or three years, as senators push the AI Overwatch Act to bar such sales for at least...

Read more

Intel Signs Its First Outside Customer for 18A Chips and Names Microsoft as Its First Public Customer for EMIB Packaging, After Losing More Than Half Its Value Since September

by Team Lumida
2 days ago
Intel Surges 5%, SK Hynix Up 3% on Reports of U.S. Memory Chip Manufacturing Deal to Serve Nvidia and AI Demand

Intel CEO Lip-Bu Tan said the company signed its first outside customer for 18A chips and named Microsoft as its first public EMIB packaging customer.

Read more

China’s Military Is ‘Actively Soliciting’ Nvidia’s Most Advanced Chips for AI-Enabled Military Capabilities, a Congressional Commission Says in Its 2026 Report

by Team Lumida
3 days ago

A congressional commission said China’s military is seeking advanced Nvidia chips and evading export controls, including via data centers in Malaysia.

Read more

Bipartisan Push to Attach AI Chip Export Limits to the December NDAA Gains Steam After the Huang Affair, With Schumer, Jeffries and Speaker Johnson Backing the AI Overwatch, MATCH and Chip Security Acts

by Team Lumida
3 days ago

Lawmakers from both parties are pushing three chip export bills into the December defense bill after Jensen Huang’s resignation, but time is short.

Read more

Banks Pause a $480 Million Nvidia GPU Loan to Aolani Cloud Tied to ByteDance After New US Licensing Rules for Malaysia and Singapore Data Centers

by Team Lumida
4 days ago
ByteDance Is Buying Custom Chips From Taiwan Because It Cannot Buy Nvidia’s, Which US Rules Permit

Banks paused or reconsidered a $480 million Aolani Cloud loan for Nvidia GPUs tied to ByteDance after new US licensing rules, Bloomberg reported.

Read more

Commerce and Justice Say They Began Investigating Nvidia Partner Megaspeed in 2024, as Critics Ask Why It Kept Getting Chips After Nvidia’s ‘No Sell’ Listing

by Team Lumida
4 days ago

Commerce and Justice said they opened export-control probes into Megaspeed in 2024 and inspected it in June 2025, as critics question how it kept buying chips.

Read more

Nvidia Warns Chip Buyers That the Remote Access Security Act Could Expose Them to US ‘Legal Action’ and Caps Sales to Clouds Renting Over 50% of GPUs to Chinese Firms

by Team Lumida
4 days ago

Nvidia cautioned customers that the proposed Remote Access Security Act could bring US legal action over Chinese cloud access to its chips, CNBC reported.

Read more
Next Post
Discounts on the Rise: How Consumer Frugality is Shaping Market Trends

Discounts on the Rise: How Consumer Frugality is Shaping Market Trends

Big AI is Out, Small AI is In: The New Industry Trend

Big AI is Out, Small AI is In: The New Industry Trend

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Related News

Bank of America Q4 2024 Earnings Analysis

Bank of America’s Moynihan Says Merrill Must Double Its $80 Billion Pace of Fee-Based Inflows to Hit Its Goal, Eyeing 5 Million Untapped Wealthy Clients

November 11, 2026
Apple Store shop front

Apple Is Lobbying Trump Officials to Buy Memory Chips From Pentagon-Blacklisted Chinese Companies

July 2, 2026
Coinbase Q2 2024 Earnings Highlights: Diversification Drives Sixth Consecutive Quarter of Positive Adjusted EBITDA

Coinbase Wins Conditional Federal Trust Charter — A Major Step Toward Becoming the Infrastructure Layer for Institutional Crypto

April 3, 2026

Subscribe to Lumida Ledger

Browse by Category

  • Lifestyle
    • Family Office
    • Health and Longevity
    • Legacy
    • Next Gen Wealth
    • Trust, Tax, and Estate
  • News
    • Alt Assets
    • Crypto
    • Equities
    • Latest
    • Macro
    • Markets
    • Real Estate
  • Opinions
    • Investing Philosophy
    • Op-Ed
  • Research
    • Trackers
  • Themes
    • Aging & Longevity
    • AI
    • Biotech
    • CRE
    • Cybersecurity
    • Digital Assets
    • Legacy Brands
    • Nuclear Renaissance
    • Private Credit
    • Software
Facebook Twitter Instagram Youtube TikTok LinkedIn
Lumida News

Premium insights to help you invest beyond the ordinary. Lumida Wealth Management LLC (‘Lumida”) is an SEC registered investment adviser

CATEGORIES

  • Aging & Longevity
  • AI
  • Alt Assets
  • Biotech
  • CRE
  • Crypto
  • Cybersecurity
  • Digital Assets
  • Equities
  • Family Office
  • Health and Longevity
  • Investing Philosophy
  • Latest
  • Legacy
  • Legacy Brands
  • Lifestyle
  • Macro
  • Markets
  • News
  • Next Gen Wealth
  • Nuclear Renaissance
  • Op-Ed
  • Private Credit
  • Real Estate
  • Software
  • Themes
  • Trackers
  • Trust, Tax, and Estate

BROWSE BY TAG

AI AI chips Amazon Apple Artificial Intelligence Banking Bank of America China Commercial Real Estate CPI data centers Donald Trump EARNINGS ELON MUSK Federal Reserve financial services generative AI Goldman Sachs Google India Inflation Interest Rates Investment Strategy Japan Jerome Powell JPMorgan Markets Meta Microsoft Nasdaq Novo Nordisk Nuclear Energy Nvidia oil OpenAI private equity S&P 500 SEC Semiconductor stock market stock surge Tech Stocks tesla Trump Whale Watch

© 2025 Lumida Wealth Management LLC is an SEC registered investment adviser. Privacy Policy. Cookies Policy.
Disclaimer Important Information This site is for informational purposes only. Information presented on this site does not constitute as investment advice.

Lumida Wealth Management LLC (‘Lumida”) is an SEC registered investment adviser. SEC registration does not constitute an endorsement of the firm by the Commission nor does it indicate that the adviser has attained a particular level of skill or ability.

Lumida's website (referred to herein as the "Website") is limited to the dissemination of general information pertaining to its advisory services, together with access to additional investment-related information, publications, and links. Accordingly, the publication of the Website on the Internet should not be construed by any client and/or prospective client Lumida’s solicitation to effect, or attempt to effect transactions in securities, or the rendering of personalized investment advice for compensation, over the Internet.

Any subsequent, direct communication by Lumida with a prospective client will be conducted by a representative that is either registered or qualifies for an exemption or exclusion from registration in the state where the prospective client resides.

‍Lead Capture Forms: By submitting your contact information in the forms on this site, you are not obligated to invest in Lumida's product or services.
‍Address: Lumida Wealth Management, 25 W 39th Street Suite 700, New York, NY 10018

No Result
View All Result
  • Home
  • Earnings
  • News
    • Alt Assets
    • Crypto
    • Equities
    • Macro
    • Markets
    • Real Estate
  • Lifestyle
    • Family Office
    • Health and Longevity
  • Themes
    • Aging & Longevity
    • AI
    • CRE
    • Digital Assets
    • Legacy Brands
    • Nuclear Renaissance
    • Private Credit
  • About Us

© 2025 Lumida Wealth Management LLC is an SEC registered investment adviser. Privacy Policy. Cookies Policy.
Disclaimer Important Information This site is for informational purposes only. Information presented on this site does not constitute as investment advice.

Lumida Wealth Management LLC (‘Lumida”) is an SEC registered investment adviser. SEC registration does not constitute an endorsement of the firm by the Commission nor does it indicate that the adviser has attained a particular level of skill or ability.

Lumida's website (referred to herein as the "Website") is limited to the dissemination of general information pertaining to its advisory services, together with access to additional investment-related information, publications, and links. Accordingly, the publication of the Website on the Internet should not be construed by any client and/or prospective client Lumida’s solicitation to effect, or attempt to effect transactions in securities, or the rendering of personalized investment advice for compensation, over the Internet.

Any subsequent, direct communication by Lumida with a prospective client will be conducted by a representative that is either registered or qualifies for an exemption or exclusion from registration in the state where the prospective client resides.

‍Lead Capture Forms: By submitting your contact information in the forms on this site, you are not obligated to invest in Lumida's product or services.
‍Address: Lumida Wealth Management, 25 W 39th Street Suite 700, New York, NY 10018