Introduction Broadcasting is a fundamental feature in PyTorch that enables element-wise operations between tensors of different shapes. When performing these operations, PyTorch automatically expa...

Introduction The past two posts have laid the groundwork for understanding the mathematical underpinnings of neural networks. In each post, we briefly covered: Gradient and Derivative: The conce...

Introduction In our previous post, we explored the fundamental concept of derivatives and their application in neural networks. We manually performed backpropagation using the chain rule, adjustin...

Introduction This post revisits the fundamental concepts of derivatives and highlights their crucial role in training neural networks. We will begin by methodically calculating the derivative of a...