LINEAiGE
AI HISTORY

A Neural Probabilistic Language Model

Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Jauvin published A Neural Probabilistic Language Model in the Journal of Machine Learning Research in February 2003. The paper proposed learning distributed word representations jointly with a neural probability function for word sequences to address generalization limits associated with the curse of dimensionality.

February 2003AI HISTORYVERIFIED

Historical classification

This verified record belongs to LINEAiGE's artificial-intelligence history layer beginning in 1956.

Why it matters

A documented neural language-modeling research milestone combining learned distributed word representations with a neural network probability model for word sequences.

People, organizations & technologies

PEOPLE
Yoshua Bengio, Réjean Ducharme, Pascal Vincent, Christian Jauvin

TECHNOLOGIES
Neural probabilistic language model, Distributed word representations, Neural networks, Statistical language modeling

Evidence & verification

STATE
verified

CONFIDENCE
high

LAST VERIFIED
2026-09-11T14:04:48+08:00

The official Journal of Machine Learning Research article page identifies the authors, volume, pages, and February 2003 publication month and directly states that the model learns a distributed representation for each word together with a probability function for word sequences using neural networks. The JMLR paper PDF independently records 'Published 2/03'. This record preserves month precision and does not infer an exact publication day, system-birth date, geography, ancestry, influence, causality, or relationships.

Sources

SOURCE 1 · PRIMARY · CLAIM-EVIDENCE

A Neural Probabilistic Language Model

Journal of Machine Learning Research

SOURCE 2 · PRIMARY · CORROBORATION

A Neural Probabilistic Language Model (PDF)

Journal of Machine Learning Research

Trace the chronology

Record identity

LINEAiGE ID
neural-probabilistic-language-model-2003