Knowledge Base
A collection of notes from my personal knowledge management system.
94 notes
Deep Learning
Neural Network Backbone
#Activation Function
#Backpropagation
#Cross-Entropy Loss
#Gradient Descent
+8
LLM
Absolute Positional Embedding
Parser/Compiler
Abstract Syntax Tree (AST)
Deep Learning
Activation Function
#Activation Function
LLM
Aha Moment (Deep Seek R1)
#LRM
AI
Artificial General Intelligence (AGI)
Paper Machine Learning
Attention Is All You Need
Deep Learning LLM
Attention Mechanism
LLM
Attention Scores
#Transformer
LLM
Attention Weights
#Transformer
Parser/Compiler
Back End (Compiler)
Deep Learning
Backpropagation
#Backpropagation
LLM
Batch Size
Deep Learning
Bidirectional Encoder Representations from Transformers (BERT)
#Transformer
#BERT
Rust
Borrow Checker
LLM
BOS Token
LLM
Broadcasting (Tensor Operation)
#PyTorch
Deep Learning
Causal Attention
LLM Prompt Engineering
Chain-of-Thought Prompting
Paper LLM Prompt Engineering
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
LLM
Compiler Feedback Loop
#RL
Parser/Compiler
Concrete Syntax Tree (CST)
LLM
Context Vector
#Transformer
LLM
Context Window
Parser/Compiler
Control Flow Graph (CFG)
LLM
DataLoader (PyTorch)
#PyTorch
Deep Learning
Decoder (Transformer)
Paper LLM
DeepSeek-R1 - Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
#LRM
Parser/Compiler
Desugaring
LLM
Emergent Behavior
Deep Learning
Encoder (Transformer)
LLM
EndOfText Token
EOS Token
Parser/Compiler
Escape Analysis
LLM
Few-shot Learning
Machine Learning
Fine-Tuning
Machine Learning Deep Learning
Foundational Model
Parser/Compiler
Front End (Compiler)
Computer Science
Garbage Collection
LLM
GGUF (GPT-Generated Unified Format)
LLM
Inference Time Compute Scaling
#LRM
LLM
Input Embeddings (Transformer)
#Transformer
LLM
Input-Target Pairs
Parser/Compiler
IR Construction (Intermediate Representation Construction)
Parser/Compiler
Lexical Analysis
LLM
LlamaEdge
LLM
LLM Distillation
Machine Learning
Loss Function
#Loss Function
LLM
Low-Rank Adaptation (LoRA)
#Fine-Tuning
Parser/Compiler
Lowering (Compiler)
Computer Science
Memory Safety
Parser/Compiler
Middle End (Compiler)
Deep Learning
Multi-head Attention
LLM
Next Word Prediction
Parser/Compiler
Noding
LLM
One-Hot Encoding
LLM
One-shot Learning
Rust
Ownership (Rust)
LLM
Parallel Computing (DataLoader)
Deep Learning
Parameter-Efficient Fine-Tuning (PEFT)
#Fine-Tuning
LLM
Positional Embedding
Machine Learning
Pre-training
LLM
Quantization (DeepSeek)
LLM
Quantized Low-Rank Adaptation (QLoRA)
#Fine-Tuning
Deep Learning
Query, Key, Value (QKV)
Rust
RAII (Resource Acquisition Is Initialization)
LLM
Reasoning Model Blueprint (SFT + RL)
#LRM
Deep Learning
Rectified Linear Unit (ReLU)
#Activation Function
#ReLU
Parser/Compiler
Recursive Descent Parser
Parser/Compiler
Register Allocation
Machine Learning
Reinforcement Learning (RL)
#RL
LLM
Relative Positional Embedding
Rust
Rust (Programming Language)
LLM
Scaled Dot-Product Attention
#Transformer
Deep Learning
Self-Attention Mechanism
Machine Learning
Self-Supervised Learning (SSL)
LLM
Sliding Window Technique
Deep Learning
Softmax Function
#Activation Function
#Softmax
Parser/Compiler
Static Single Assignment (SSA)
LLM
Stride (Sliding Window Technique)
Machine Learning
Supervised Fine-Tuning (SFT)
#Fine-Tuning
LLM
System 1 Thinking
#LRM
LLM
System 2 Thinking
#LRM
LLM
Test Time Compute
#LRM
Book
Thinking Fast and Slow - Daniel Kahneman
LLM
Token ID (LLM)
LLM
Tokenization
Deep Learning LLM
Transformer
Parser/Compiler
Type Checking (Compiler)
LLM
Vector Embedding
Deep Learning
Vision Language Model (VLM)
#VLM
LLM
Vocabulary (Tokenizer)
Parser/Compiler
Walk (Compiler)
LLM
