Lists are mutable, meaning their values can be changed after creation. Tuples are immutable and cannot be modified once created. Lists use square brackets [], while tuples use parentheses (). Tuples are generally faster and used for fixed data.

A shallow copy copies only the reference of nested objects, so changes in nested objects affect both copies. A deep copy creates completely independent copies of all nested objects. Python provides copy() for shallow copy and deepcopy() from the copy module for deep copy.

Decorators are functions that modify the behavior of another function without changing its actual code. They are commonly used for logging, authentication, timing, and access control. Decorators use the @ symbol before the function definition.

A lambda function is a small anonymous function written in a single line using the lambda keyword. It is mainly used for short operations inside functions like map(), filter(), and sorted().

List comprehension provides a compact way to create lists using a single line of code. It improves readability and performance compared to traditional loops. Example: squares = [x*x for x in range(5)]

== checks whether two objects have equal values, while is checks whether two variables point to the same memory location. == compares content, whereas is compares object identity.

Generators are functions that return values one at a time using the yield keyword instead of return. They are memory efficient because they generate items only when needed instead of storing all values in memory.

append() adds a single element to the end of a list, while extend() adds multiple elements from another iterable to the list. Example: list1.append([4,5]) list1.extend([4,5])

Exception handling prevents program crashes by handling runtime errors using try, except, finally, and raise blocks. It helps maintain program flow even when errors occur.

NumPy is a Python library used for numerical computing. It provides fast multidimensional arrays and mathematical operations. NumPy is highly optimized and widely used in machine learning and data analysis.

NumPy arrays are faster, consume less memory, and support vectorized operations. Python lists are more flexible but slower for numerical computations. NumPy arrays are mainly used in scientific computing and machine learning.

Pandas is a Python library used for data manipulation and analysis. It provides powerful data structures like DataFrame and Series for handling structured data efficiently.

A DataFrame is a two-dimensional tabular data structure in Pandas with rows and columns. It is similar to an Excel sheet or SQL table and is widely used for data analysis.

loc accesses data using row and column labels, while iloc accesses data using integer index positions. Example: df.loc[0,'Name'] df.iloc[0,1]

Missing values can be handled using methods like dropna(), fillna(), forward fill, backward fill, or replacing with mean, median, or mode values depending on the dataset.

groupby() is used to split data into groups based on specific columns and perform aggregate operations like sum, average, count, or maximum values.

merge() combines DataFrames based on common columns similar to SQL joins, while concat() combines DataFrames vertically or horizontally without matching keys.

Vectorization performs operations on entire arrays or columns at once instead of using loops. It improves performance and reduces execution time significantly.

pivot_table() is used to summarize and aggregate data in a tabular format similar to Excel pivot tables. It helps analyze grouped data efficiently.

Python is popular in Data Science because of its simple syntax, large ecosystem of libraries, strong community support, and powerful frameworks like NumPy, Pandas, Scikit-learn, TensorFlow, and PyTorch.

Popular Data Science libraries include NumPy for numerical computing, Pandas for data analysis, Matplotlib and Seaborn for visualization, Scikit-learn for machine learning, and TensorFlow/PyTorch for deep learning.

Scikit-learn is a machine learning library in Python that provides tools for classification, regression, clustering, preprocessing, model evaluation, and feature selection.

CSV files are commonly read using Pandas with the read_csv() function. Example: import pandas as pd df = pd.read_csv('data.csv')

Data preprocessing is the process of cleaning and transforming raw data before training machine learning models. It includes handling missing values, encoding, scaling, and removing duplicates.

Feature scaling standardizes numerical data to ensure all features contribute equally to machine learning models. Common methods include normalization and standardization.

One-hot encoding converts categorical variables into binary columns so machine learning models can process non-numeric data efficiently.

Data visualization is commonly done using Matplotlib and Seaborn libraries. They help create plots like bar charts, histograms, scatter plots, and heatmaps for better data understanding.

Supervised learning uses labeled data to predict outputs, while unsupervised learning finds hidden patterns in unlabeled data. Examples include regression for supervised learning and clustering for unsupervised learning.

A Data Science project usually includes problem understanding, data collection, preprocessing, exploratory data analysis, feature engineering, model building, evaluation, and deployment. Python libraries like Pandas, NumPy, and Scikit-learn are commonly used throughout the workflow.