Curse of Dimensionality
A central difficulty in high-dimensional data analysis: as dimensionality increases, the sample size required for nonparametric estimation grows exponentially, causing the convergence rates of methods such as kernel density estimation and kernel mean embedding to lose practical utility.
Timeline (last 90 days)
The curse of dimensionality refers to the fact that as the covariate dimension d increases, the sample size required for non-parametric estimation grows exponentially, causing methods such as kernel density estimation and kernel mean embedding to lose practical convergence rates.
The paper proves that, under appropriate network depth and width configurations, the convergence rate of dense ReLU networks can overcome the curse of dimensionality, achieving polynomial-level sample complexity.
All Facts (3)
The curse of dimensionality refers to the fact that as the covariate dimension d increases, the sample size required for non-parametric estimation grows exponentially, causing methods such as kernel density estimation and kernel mean embedding to lose practical convergence rates.
50%UnverifiedThe paper proves that, under appropriate network depth and width configurations, the convergence rate of dense ReLU networks can overcome the curse of dimensionality, achieving polynomial-level sample complexity.
50%Unverified对高基数类别特征进行独热编码会导致特征空间急剧膨胀，造成维度灾难，使欧氏距离在高维稀疏空间中区分能力急剧下降
50%