RESEARCH BASE

Search 3,717 documents across 34 fields — every claim tier-rated by evidence

3,717 documents 34 sections 47,686 citations 34,596+ keywords indexed 4 evidence tiers

2 results for "self-attention"

ZD_2_15 Verified Information & Computation

ZD_2_15 — Transformer Architecture: Self-Attention and the Foundation of Modern AI

The transformer is a neural network architecture introduced in 2017 that replaced recurrent and convolutional models as the dominant paradigm in artificial intelligence. Its core innovation — the self-attention mechanism

transformer self-attention multi-head attention positional encoding encoder-decoder BERT

S_1_16 Verified Future Technology

S_1_16 — Large Language Models: Architecture, Capabilities, and Societal Impact

Large Language Models (LLMs) are neural networks with billions to trillions of parameters, trained on massive text corpora to predict the next token in a sequence. Built on the transformer architecture introduced by Vasw

large language models LLM GPT transformer BERT natural language processing

BROWSE BY SECTION — 3717 documents across 34 fields

A Foundations 112 docs B Beings & Entities 114 docs C Global Traditions 116 docs D Sites & Artifacts 116 docs E Cataclysms & Chronology 109 docs F Lost Connections 111 docs G Modern Frameworks 99 docs H Suppression & Thesis 95 docs I UAP Disclosure 87 docs J Ancient Technology 103 docs K Consciousness 100 docs L Genetics & Origins 92 docs M Forbidden Archaeology 103 docs N Secret Societies 87 docs O Earth Anomalies 108 docs P Philosophy & Meaning 104 docs Q Cosmology & Physics 100 docs R Biology & Evolution 94 docs S Future Technology 100 docs T Psychology & Social 112 docs U Art, Music & Culture 122 docs V Mathematics & Information 87 docs W World Civilizations 140 docs X Medicine & Healing 126 docs Y Altered States 113 docs Z Molecular Biology 112 docs ZA Physics & Quantum 117 docs ZB Ecology & Biology 118 docs ZC Social Science 111 docs ZD Information & Computation 95 docs ZE Ethics & Applied Philosophy 99 docs ZF Oceanography 105 docs ZG Linguistics & Communication 110 docs ZH Archaeoastronomy 114 docs