Menu bar

Showing posts with label 0-Linear Algebra. Show all posts
Showing posts with label 0-Linear Algebra. Show all posts

17/08/2021

Linear Regression

Linear regression is a method for modeling the relationship between one or more independent variables and a dependent variable. 

It is a staple of statistics and is often considered a good introductory machine learning method. 

In this tutorial, you will discover the matrix formulation of linear regression and how to solve it using direct and matrix factorization methods.

Singular Value Decomposition

Matrix decomposition, also known as matrix factorization, involves describing a given matrix using its constituent elements. 

Perhaps the most known and widely used matrix decomposition method is the Singular-Value Decomposition, or SVD.

All matrices have an SVD, which makes it more stable than other methods, such as the eigendecomposition. 

As such, it is often used in a wide array of applications including compressing, denoising, and data reduction.

16/08/2021

Eigendecomposition

Matrix decompositions are a useful tool for reducing a matrix to their constituent parts in order to simplify a range of more complex operations. 

Perhaps the most used type of matrix decomposition is the eigendecomposition that decomposes a matrix into eigenvectors and eigenvalues. 

Matrix Decompositions

Many complex matrix operations cannot be solved efficiently or with stability using the limited precision of computers. 

Matrix decompositions are methods that reduce a matrix into constituent parts that make it easier to calculate more complex matrix operations. 

Matrix decomposition methods, also called matrix factorization methods, are a foundation of linear algebra in computers, even for basic operations such as solving systems of linear equations, calculating the inverse, and calculating the determinant of a matrix.

15/08/2021

Principal Component Analysis

An important machine learning method for dimensionality reduction is called Principal Component Analysis (PCA).

It is a method that uses simple matrix operations from linear algebra and statistics to calculate a projection of the original data into the same number or fewer dimensions.

In this tutorial, you will discover the PCA machine learning method for dimensionality reduction and how to implement it from scratch in Python.

14/08/2021

Introduction to Multivariate Statistics

Fundamental statistics are useful tool in applied machine learning for better understanding your data. 

They are also the tools that provide the foundation for more advanced linear algebra operations and machine learning methods, such as the Covariance Matrix and Principal Component Analysis respectively.

In this tutorial, you will discover how fundamental statistical operations work and how to implement them using Numpy.

Tensors and Tensor Arithmetic

In deep learning it is common to see a lot of discussion around tensors as the cornerstone data structure. 

Tensor even appears in name of Google’s flagship machine learning library: TensorFlow. 

Tensors are a type of data structure used in linear algebra, and like vectors and matrices, you can calculate arithmetic operations with tensors.

This tutorial is divided into 3 parts; they are:
  • What are Tensors
  • Tensors in Python
  • Tensor Arithmetic

13/08/2021

Sparse Matrix

A sparse matrix is a matrix that is comprised of mostly zero values. Sparse matrices are distinct from matrices with mostly non-zero values, which are referred to as dense matrices. 

Below is an example of a small 3 × 6 sparse matrix


The example has 13 zero values of the 18 elements in the matrix, giving this matrix a sparsity score of 0.722 or about 72%.

07/08/2021

NumPy Array Broadcasting

Arrays with difference sizes cannot be added, subtracted, or generally be used in arithmetic. A way to overcome this is to duplicate the smaller array so that it has the dimensionality and size as the large array. This is called array broadcasting.