What is the main objective of reinforcement learning? To reduce the computational complexity To minimize the error rate in predictions To increase the speed of learning To maximize the expected reward obtained by an agent

To maximize the expected reward obtained by an agent

What is the actor in policy-based reinforcement learning? A function that evaluates the value of a state A neural network that determines the probability of taking each action A model that predicts future states A rule-based system for decision making

A neural network that determines the probability of taking each action

What does \[ R_θ \] represent in reinforcement learning? The exploration rate in Q-learning The expected reward obtained by an actor The learning rate of the algorithm The discount factor for future rewards

The expected reward obtained by an actor

What is the purpose of the Monte Carlo method in reinforcement learning? To optimize the policy function directly To estimate the expected return from complete episodes/trajectories To improve the exploration-exploitation balance To reduce the variance in reward estimation

To estimate the expected return from complete episodes/trajectories

What does the Q-function represent in Q-learning? The immediate reward received after an action The expected cumulative reward obtained from a state-action pair The policy function for decision making The probability of taking an action given a state

The expected cumulative reward obtained from a state-action pair

What problem does experience replay in reinforcement learning aim to solve? Correlated samples in training data Slow convergence of the algorithm High variance in reward estimation Overfitting to the training set

Correlated samples in training data

What is Artificial Intelligence, focusing on its ability to build machines that can think and act like humans? Development of intelligent machines or smart systems A subset of AI that enables machines to learn from data A statistical method for modeling relationships A type of deep learning architecture for visual imagery

Development of intelligent machines or smart systems

What is Machine Learning, a subset of AI that enables machines to learn from data? A Python library for numerical data A method for data visualization A subset of Artificial Intelligence that enables machines to learn from data A type of machine learning using labeled data

A subset of Artificial Intelligence that enables machines to learn from data

What are two advantages of Artificial Intelligence in terms of efficiency and productivity? Dependency on human input Complexity and high cost Increased efficiency and productivity Limited data requirements

Increased efficiency and productivity

What is NumPy, a Python library known for its efficiency in working with numerical data? A tool for data visualization A method for detecting outliers Python library, better at working with numerical data efficiently A type of machine learning algorithm

Python library, better at working with numerical data efficiently

What is Pandas, a Python library known for its capabilities in data manipulation and analysis? A statistical method for modeling relationships A type of deep learning architecture A subset of AI for learning from data Python library, better at data manipulation and analysis

Python library, better at data manipulation and analysis

What is the purpose of Matplotlib and Seaborn in the context of data visualization? They are both popular Python libraries used for data visualization They are algorithms for supervised learning They are used for numerical data manipulation They are methods for detecting outliers

They are both popular Python libraries used for data visualization

What are the main differences between Matplotlib and Seaborn in terms of usability and design? Matplotlib is a powerful but complex tool, Seaborn offers pre-designed charts Both are used for numerical data manipulation Matplotlib is for data manipulation, Seaborn is for machine learning Both are used for detecting outliers

Matplotlib is a powerful but complex tool, Seaborn offers pre-designed charts

Define Supervised Learning in Machine Learning, focusing on its use of labeled data. It is a method for detecting outliers It is a tool for data visualization It is a subset of AI for learning from data Supervised learning is a type of machine learning that trains algorithms using labeled data

Supervised learning is a type of machine learning that trains algorithms using labeled data

Define Unsupervised Learning in Machine Learning, focusing on its ability to find patterns without labeled data. It uses labeled data for training The algorithms find patterns and structures without labeled data It is a tool for numerical data manipulation It is a method for data visualization

The algorithms find patterns and structures without labeled data

What is Linear Regression, and how does it relate to finding patterns in data? A tool for data visualization A type of deep learning architecture for visual imagery A statistical method for modeling the relationship between a dependent variable and one or more independent variables A subset of AI for learning from data

A statistical method for modeling the relationship between a dependent variable and one or more independent variables

What is the main assumption for linear regression, and what are two of the three assumptions for the residuals? Residuals are independent and identically distributed; mean of residuals is zero Residuals are normally distributed; residuals have a mean of zero Residuals have constant variance; residuals are independent of each other Conditional mean of Y is linear in X; residuals are normally distributed and have constant variance

Conditional mean of Y is linear in X; residuals are normally distributed and have constant variance

In the context of linear regression, how is a unit increase in \[ x_1 \] reflected in Y? Y will decrease by the amount \[ eta_1 \] Y will be multiplied by \[ eta_1 \] Y will remain unchanged Y will be increased by the amount \[ eta_1 \]

Y will be increased by the amount \[ eta_1 \]

Define the collinearity problem and name two ways this affects our coefficient estimates. Parameter estimates are unaffected; does not impact model performance Parameter estimates are stable; improves model accuracy Parameter estimates have high uncertainty; affects interpretation and inflates uncertainty Parameter estimates are precise; reduces model complexity

Parameter estimates have high uncertainty; affects interpretation and inflates uncertainty

How is the Maximum Likelihood Estimate related to Ordinary Least Squares? OLS minimizes the variance of the residuals OLS is unrelated to Maximum Likelihood Estimation Minimizing MSE on the training data yields the Maximum Likelihood Estimate solution Maximizing the likelihood function gives the OLS solution

Minimizing MSE on the training data yields the Maximum Likelihood Estimate solution

How can you identify overfitting when plotting training and test errors as a function of model complexity or training time? Training error will increase while test error decreases Both training and test errors will increase Both training and test errors will decrease The training error and test error will begin to diverge

The training error and test error will begin to diverge

What is the purpose of regularization in machine learning models? To reduce the size of the dataset To prevent overfitting by adding a penalty term To improve training speed To increase model complexity

To prevent overfitting by adding a penalty term

What does the regularization parameter do, and what does it effectively control? Reduces the number of features; controls feature selection Increases the dataset size; controls data augmentation Imposes a penalty on less desirable solutions; controls model complexity Increases the learning rate; controls training speed

Imposes a penalty on less desirable solutions; controls model complexity

What does a small value of lambda (alpha) signify, and what does a large value signify in regularization? Small value: High regularization, prevents overfitting; Large value: No regularization, allows overfitting Small value: No effect on model; Large value: Improves model accuracy Small value: Increases model complexity; Large value: Reduces model complexity Small value: Little regularization, allows overfitting; Large value: Large regularization, leads to underfitting

Small value: Little regularization, allows overfitting; Large value: Large regularization, leads to underfitting

Why is it customary to standardize all independent variables before regularization? So that large coefficients aren't penalized more severely To increase the speed of convergence To improve the interpretability of the model To reduce the number of features

So that large coefficients aren't penalized more severely

Computer Science

Flashcard >
Science >
Computer Science

Flashcard sets

View All

Software Engineering

Comprehensive Exploration of Reinforcement Learning Concepts and Methods

user_pereira_de_andr

MCQ 50 Cards

Software Engineering

Comprehensive Overview of Artificial Intelligence and Machine Learning Concepts

mmoranwkf

MCQ 20 Cards

Software Engineering

CC5 "Reviewer"

mmoranwkf

Fill in Blanks 19 Cards

Textbooks

View All

Expert Q&A

View All

Software Engineering

Comprehensive Exploration of Reinforcement Learning Concepts and Methods

user_pereira_de_andr

MCQ 50 Cards

Software Engineering

Comprehensive Overview of Artificial Intelligence and Machine Learning Concepts

mmoranwkf

MCQ 20 Cards

Software Engineering

CC5 "Reviewer"

mmoranwkf

Fill in Blanks 19 Cards

Software Engineering

Comprehensive Guide to Big Data and Analytics Concepts and Tools

user_lira_cofre

MCQ 37 Cards

Software Engineering

Comprehensive Guide to Machine Learning Concepts and Techniques

user_striner

MCQ 99 Cards

Software Engineering

Comprehensive Guide to Machine Learning Concepts and Techniques

user_kumartyv

MCQ 34 Cards

Software Engineering

Comprehensive AI and Machine Learning Concepts and Applications

user_jevbwl

MCQ 94 Cards

Software Engineering

Understanding AI Concepts: From Deepfakes to Neural Networks

user_kambeorv

MCQ 48 Cards

Software Engineering

Understanding Key Concepts in AI, IoT, AR, and VR Technologies

user_kumartyv

Fill in Blanks 14 Cards

Software Engineering

KNN & Other Ideas

user_pereira_de_andr

MCQ 22 Cards

Software Engineering

Understanding SAP Business AI and LLMs: Key Concepts and Applications

snashuhaimdinx

MCQ 64 Cards

Software Engineering

AWS Certified AI Practitioner

user_kumartyv

MCQ 100 Cards

Software Engineering

Comprehensive Guide to Probability, Search Algorithms, and Optimization Techniques

user_kambeorv

MCQ 37 Cards

Software Engineering

Understanding AI: Learning, Ethics, Applications, and Challenges

user_hodr

MCQ 10 Cards

Software Engineering

Understanding Generative AI: Concepts, Applications, and Implications

user_pereira_de_andr

MCQ 15 Cards