Machine Learning is an exciting topic with a myriad of applications. However, most textbooks are targeted towards Computer Science students. This, however, creates a complication for scientists across the physical sciences that also want to understand the main concepts of Machine Learning and look ahead to applications and advancements in their fields. This textbook bridges this gap, providing an introduction to the mathematical foundations for the main algorithms used in Machine Learning for those from the physical sciences, without a formal background in Computer Science. The main goal was to translate many Machine Learning algorithms into a language that physicists can understand and use. To achieve this goal, a combination of discussions, mathematical formalism, and coding was used. The language chosen for the codes was Julia.