[KongchangAI]

#NLP

10 related articles

Seq2Seq Model Only Predicts Padding Tokens? Common Causes and Fixes
·2 min

Seq2Seq Model Only Predicts Padding Tokens? Common Causes and Fixes

Seq2seq models predicting only padding tokens is a classic beginner mistake. Learn the root causes — unmasked loss, data imbalance — and fixes like loss masking and teacher forcing.

Read more →
The Price of Token Boundaries: Quantifying the Trade-off Between Compression Efficiency and Prediction Quality
·2 min

The Price of Token Boundaries: Quantifying the Trade-off Between Compression Efficiency and Prediction Quality

New arXiv paper quantifies the cost of tokenization boundaries: boundary rules increase optimal token counts by 28.3–36.8% on English Wikipedia, and BPE sits 10.9% above the unconstrained lower bound. Compression and prediction favor different vocabularies.

Read more →
Text Classification Models Evolved: A Visual Journey from Bag-of-Words to Transformers
·2 min

Text Classification Models Evolved: A Visual Journey from Bag-of-Words to Transformers

From Bag-of-Words to RNN, CNN, and Transformers, this article visually traces the evolution of text classification models and explores accuracy, efficiency, and calibration tradeoffs.

Read more →
A Sober Look at TypeSafe AI's Jev: Genuine Architecture or Overhyped?
·1 min

A Sober Look at TypeSafe AI's Jev: Genuine Architecture or Overhyped?

A veteran NLP practitioner argues that TypeSafe AI's Jev looks more like an improvement on existing classifiers and language models than a brand-new AI paradigm — and that key architectural details and independent benchmarks are still missing.

Read more →
Stop Removing Stopwords: How an Inherited Preprocessing Default Distorts Legal Text Data Analysis
·2 min

Stop Removing Stopwords: How an Inherited Preprocessing Default Distorts Legal Text Data Analysis

A new arXiv paper uses exhaustive single-word ablation to show that removing stopwords in interpretable legal text analysis hurts rather than helps, distorting jurisprudential and ideological signals.

Read more →
ARR August Cycle Discussion: Review Quality, Result Timing, and Rebuttal Period Changes
·1 min

ARR August Cycle Discussion: Review Quality, Result Timing, and Rebuttal Period Changes

A deep dive into Reddit discussions on ARR's August cycle: review quality polarization, uncertain result timelines, and the rebuttal period extended from 6–7 days to 10 days.

Read more →