Category: Deep Learning
All the articles with the category "Deep Learning".
Projects

Education
Reinforcement Learning with OpenAI Gym
Implementation of Reinforcement Learning Algorithms with OpenAI Gym.
PythonPyTorchGymRLPPODQN

Personal
Build a GPT-like LLM from scratch
An attempt to build a GPT-style LLM from scratch with PyTorch. Covers the full architecture, pre-training loop, decoding strategies, and loading OpenAI GPT-2 weights.
PythonPyTorchTransformerGPT
DEV WIP

Personal
Build Large Reasoning Model (LRM) from scratch
Build a Large Reasoning Model from scratch and turn non-reasoning LLMs into reasoning LLMs.
PythonPyTorchLRMRLGRPOFine-TuningMLX

Personal
Pong (Reinforcement Learning) with WebSocket Backend
Training PPO agents to master Atari Pong using PyTorch and PettingZoo, served to browser via WebSockets.
RLPPOPyTorchFastAPIuvWebSocketPettingZooGymnasium+5
PKM Notes
Deep Learning
Activation Function
#Activation Function
Deep Learning LLM
Attention Mechanism
Deep Learning
Backpropagation
#Backpropagation
Deep Learning
Bidirectional Encoder Representations from Transformers (BERT)
#Transformer
#BERT
Deep Learning
Causal Attention
Deep Learning
Decoder (Transformer)
Deep Learning
Encoder (Transformer)
Machine Learning Deep Learning
Foundational Model
Deep Learning
Multi-head Attention
Deep Learning
Neural Network Backbone
#Activation Function
#Backpropagation
#Cross-Entropy Loss
#Gradient Descent
+8
Deep Learning
Parameter-Efficient Fine-Tuning (PEFT)
#Fine-Tuning
Deep Learning
Query, Key, Value (QKV)
Deep Learning
Rectified Linear Unit (ReLU)
#Activation Function
#ReLU
Deep Learning
Self-Attention Mechanism
Deep Learning
Softmax Function
#Activation Function
#Softmax
Deep Learning LLM
Transformer
Deep Learning
Vision Language Model (VLM)
#VLM
