Comprehensive Study of Linear Algebra and Machine Learning Concepts

Flashcard Icon

Flashcard

Learn Mode Icon

Learn Mode

Match Icon

Match

Coming Soon!
Library Icon

Library

View Library
Match Icon

Create

Create More Decks
Flashcard Icon Flashcards
Flashcard Icon Flashcards
Library Icon Library
Match Icon Match (Coming Soon)

Computer Science - Artificial Intelligence

View Results
Full Screen Icon

user_hassanuml Created by 9 mon ago

Cards in this deck(100)
What is the formula for the norm of a vector \( v \)?
Blur Image
How is the distance between two vectors \( u \) and \( v \) calculated?
Blur Image
Two vectors \( u \) and \( v \) are orthogonal if their dot product is _____.
Blur Image
Which type of learning algorithm uses labeled data to learn a function for regression and classification?
Blur Image
Which learning algorithm uses unlabeled data to extract patterns, often used for clustering?
Blur Image
What is the primary goal of a clustering algorithm?
Blur Image
Which algorithm involves picking \( k \) cluster centers randomly and iterating until convergence?
Blur Image
What measures the 'goodness' of a clustering when the ground truth is known or unknown?
Blur Image
Which algorithm labels a test point based on the labels of the \( k \) closest training samples?
Blur Image
What is the challenge with k-NN in high dimensions where distances become strange?
Blur Image
What is the difference between a parameter and a hyperparameter in a model?
Blur Image
How do you determine the 'best' \( k \) in a model while avoiding overfitting?
Blur Image
How can a system of \( m \) equations in \( n \) unknowns be written as a vector equation?
Blur Image
How is a system of \( m \) equations in \( n \) unknowns represented as a matrix equation?
Blur Image
What are the possible numbers of solutions for a linear system?
Blur Image
A vector equation is consistent if and only if vector \( b \) is in the span of _____.
Blur Image
A consistent system has exactly one solution if and only if the vectors form a _____.
Blur Image
How many floating-point operations (flops) does it take to perform Gaussian elimination on an \( n \times n \) matrix?
Blur Image
In Reduced Row Echelon Form (RREF), a linear system is consistent if there are no rows containing _____.
Blur Image
In Reduced Row Echelon Form (RREF), a linear system is unique if there are no _____.
Blur Image
Matrices can be thought of as functions or transformations over space. What does \( Ax = b \) represent?
Blur Image
What is the result of the linear transformation \( T(cu + dv) \)?
Blur Image
Which of the following is true if a matrix \( A \) is invertible?
Blur Image
Is a non-square matrix invertible?
Blur Image
What pattern do the first non-zero entries in each row form in Row Echelon Form?
Blur Image
In Row Echelon Form, what are pivot positions and pivot columns?
Blur Image
What are the domain, codomain, and range of a linear transformation from \( R^2 \) to \( R^3 \)?
Blur Image
A transformation is linear if it is closed under addition and scalar multiplication. What does this mean?
Blur Image
What is a one-to-one transformation in terms of mapping \( T: R^n \to R^m \)?
Blur Image
What does it mean for a transformation \( T: R^n \to R^m \) to be onto \( R^m \)?
Blur Image
If a matrix is invertible, it is both _____ and _____.
Blur Image
What does the determinant of a square matrix tell us?
Blur Image
What is the inverse of a 2x2 matrix \( A \) with elements \( a, b, c, d \)?
Blur Image
How do you find the inverse of an \( m \times m \) matrix larger than 2x2?
Blur Image
How do you find matrices for transformations such as \( T(x) = rx \) where \( r = 2.5 \)?
Blur Image
What are the three properties of a subspace \( H \) in \( R^n \)?
Blur Image
True or False: Every span is a subspace.
Blur Image
What is the span of a set of vectors?
Blur Image
What is the column space of a matrix \( A \)?
Blur Image
The column space of an \( m \times n \) matrix is a subspace of _____.
Blur Image
What is the null space of a matrix \( A \)?
Blur Image
The null space of an \( m \times n \) matrix is a subspace of _____.
Blur Image
What is the basis for a subspace \( H \) of \( R^n \)?
Blur Image
How do you solve for the basis of a null space?
Blur Image
How do you solve for the basis of a column space?
Blur Image
How do you find coordinates in a new basis, for example, plotting \( x=[1, 6] \) in the standard basis and relative to new basis \( B \)?
Blur Image
What are two common types of matrix factorization?
Blur Image
What does LU decomposition represent for a matrix \( A \)?
Blur Image
What is the \( U \) matrix in LU decomposition?
Blur Image
What is the \( L \) matrix in LU decomposition?
Blur Image
How do you solve \( Ax = b \) using LU decomposition?
Blur Image
What does QR decomposition represent for a matrix \( A \)?
Blur Image
What is the \( Q \) matrix in QR decomposition?
Blur Image
What is the \( R \) matrix in QR decomposition?
Blur Image
How do you solve \( A = QR \) in QR decomposition?
Blur Image
What condition must be met for vectors \( A \) and \( B \) to be orthogonal?
Blur Image
What is the orthogonal projection of \( y \) onto \( u \)?
Blur Image
What is the Gram-Schmidt orthogonalization process?
Blur Image
What does it mean for vectors to be orthonormal?
Blur Image
If \( U \) is square and has orthonormal columns, what is true about \( U \)?
Blur Image
What is the least squares problem in terms of minimizing \( ||Ax - b||^2 \)?
Blur Image
What are the normal equations for \( Ax = b \)?
Blur Image
If \( A^T A \) is not invertible, how many solutions will there be?
Blur Image
What is the basic regression task in terms of estimating parameters?
Blur Image
What is the design matrix \( X \) in regression analysis?
Blur Image
What is the observation vector \( y \) in regression analysis?
Blur Image
What is the parameter vector \( \beta \) in regression analysis?
Blur Image
What does \( y_j \) represent in regression analysis?
Blur Image
What does \( B_0 + B_1 x_j \) represent in regression analysis?
Blur Image
What is a residual in regression analysis?
Blur Image
How do you solve linear regression problems using the least squares method?
Blur Image
What is multiple regression in terms of variables?
Blur Image
When is a matrix \( A \) invertible in terms of computational complexity?
Blur Image
What is a Markov chain in terms of a dynamical system?
Blur Image
What is an eigenvector in terms of a square matrix \( A \)?
Blur Image
What are eigenvalues in terms of eigenvectors?
Blur Image
What is an eigenspace in terms of eigenvalues?
Blur Image
How do you find all eigenvalues of a matrix \( A \)?
Blur Image
What is a diagonal matrix?
Blur Image
What is the diagonalization (eigendecomposition) of a square matrix \( A \)?
Blur Image
An \( n \times n \) matrix is diagonalizable if and only if it has _____.
Blur Image
What is the four-step process to diagonalize a matrix?
Blur Image
What does the operation \( Ax = PDP^{-1} \) decompose into?
Blur Image
What are the properties of symmetric matrices?
Blur Image
When is \( Q \) in \( Q(x) = x^T A x \) called positive definite and positive semidefinite?
Blur Image
What are the advantages of basis in relation to eigenvalues and solutions?
Blur Image
When is \( Q \) in \( Q(x) = x^T A x \) called indefinite?
Blur Image
What is a stochastic matrix?
Blur Image
What is a steady-state vector in a Markov chain?
Blur Image
How do you calculate the steady-state vector in a Markov chain?
Blur Image
What is the largest eigenvalue of a Markov Chain?
Blur Image
What does the second largest eigenvalue tell us in a Markov chain?
Blur Image
When does a Markov chain have a unique steady-state vector?
Blur Image
What is the PageRank algorithm used for?
Blur Image
In the context of PageRank, what do vertices and edges correspond to?
Blur Image
How do you compute the exact PageRank result?
Blur Image
What is Singular Value Decomposition (SVD) in terms of matrix factorization?
Blur Image
What are the three steps in the linear transformation corresponding to \( A \) in SVD?
Blur Image
What are singular values in terms of eigenvalues?
Blur Image
What does the SVD theorem state about a matrix \( A \)?
Blur Image

Ask Our AI Tutor

Get Instant Help with Your Questions

Need help understanding a concept or solving a problem? Type your question below, and our AI tutor will provide a personalized answer in real-time!

How it works

  • Ask any academic question, and our AI tutor will respond instantly with explanations, solutions, or examples.
Flashcard Icon
  • Browse questions and discover topic-based flashcards
  • Practice with engaging flashcards designed for each subject
  • Strengthen memory with concise, effective learning tools