Merge pull request #140 from codeharborhub/dev-1

added content for calculus

Author: ajay-dhangar

docs/machine-learning/mathematics-for-ml/discrete-mathematics/combinatorics.mdx

@@ -0,0 +1,73 @@
+---
+title: "Combinatorics - The Art of Counting"
+sidebar_label: Combinatorics
+description: "Mastering permutations, combinations, and counting principles essential for understanding probability, feature engineering, and model complexity."
+tags: [combinatorics, permutations, combinations, counting, discrete-math, mathematics-for-ml]
+---
+
+**Combinatorics** is the study of counting, arrangement, and combination of elements within sets. In Machine Learning, we use combinatorics to estimate the size of a hypothesis space, calculate probabilities, and understand the complexity of feature interactions.
+
+## 1. Fundamental Principles of Counting
+
+Before diving into complex formulas, we must understand the two basic rules that govern all counting.
+
+### A. The Multiplication Rule (Product Rule)
+If one task can be performed in $n$ ways and a second task can be performed in $m$ ways, then there are $n \times m$ ways to perform both tasks.
+
+**ML Example:** If you have 3 types of optimizers and 4 different learning rates to test, you have $3 \times 4 = 12$ total hyperparameter configurations.
+
+### B. The Addition Rule (Sum Rule)
+If one task can be performed in $n$ ways and another task in $m$ ways, and these tasks cannot be done at the same time, there are $n + m$ ways to choose one task.
+
+## 2. Factorials ($n!$)
+
+The factorial of a non-negative integer $n$ is the product of all positive integers less than or equal to $n$. It represents the number of ways to arrange $n$ distinct objects in a line.
+
+$$
+n! = n \times (n-1) \times (n-2) \times \dots \times 1
+$$
+
+
+## 3. Permutations vs. Combinations
+
+The most important distinction in combinatorics is whether the **order** of selection matters.
+
+### A. Permutations (Order Matters)
+A permutation is an arrangement of items where the sequence is important. The number of ways to choose $r$ items from a set of $n$ items is:
+
+$$
+P(n, r) = \frac{n!}{(n-r)!}
+$$
+
+**Example:** Selecting a "First Place" and "Second Place" winner from a group of 10.
+
+### B. Combinations (Order Does NOT Matter)
+A combination is a selection of items where the sequence is irrelevant. The number of ways to choose $r$ items from a set of $n$ items is:
+
+$$
+C(n, r) = \binom{n}{r} = \frac{n!}{r!(n-r)!}
+$$
+
+**ML Example (Feature Selection):** If you have 10 available features and you want to select a subset of 3 to train your model, there are $\binom{10}{3} = \frac{10!}{3!7!} = 120$ possible feature combinations.
+
+## 4. Combinatorics in Machine Learning
+
+### A. Hyperparameter Tuning (Grid Search)
+When performing a Grid Search, the number of models you need to train is the product of the number of values for each hyperparameter. If you have 5 hyperparameters with 10 values each, you are searching a space of $10^5$ combinations.
+
+### B. Random Forests and Bagging
+In Random Forests, we often select a random subset of features for each split in a tree. Combinatorics allows us to calculate how many unique trees can be generated from a given feature set.
+
+### C. Evaluation Metrics
+When calculating the **Confusion Matrix** (Precision, Recall), we are essentially counting occurrences of discrete events (True Positives, False Positives), which is rooted in combinatorial counting.
+
+### D. Overfitting and Model Complexity
+The more "complex" a model is, the larger its **Hypothesis Space** (the set of all possible functions it can learn). Combinatorics helps quantify this space. If a decision tree has many possible splits, the number of possible tree structures grows factorially, increasing the risk of overfitting.
+
+## 5. Binomial Coefficients and Pascal’s Triangle
+
+The combination formula $\binom{n}{r}$ is also known as the **Binomial Coefficient**. It appears in the Binomial Distribution, which is fundamental to understanding binary classification error rates.
+
+---
+
+With the ability to count possibilities, we can now move to Graph Theory to see how these discrete elements can be connected to form complex networks.

docs/machine-learning/mathematics-for-ml/discrete-mathematics/graphs.mdx

@@ -0,0 +1,62 @@
+---
+title: "Graph Theory Basics"
+sidebar_label: Graph Theory
+description: "Exploring the fundamentals of graph theory, including nodes, edges, adjacency matrices, and their applications in neural networks and Knowledge Graphs."
+tags: [graph-theory, discrete-math, networks, adjacency-matrix, mathematics-for-ml, gnn]
+---
+
+In Machine Learning, we often need to model relationships between entities. **Graph Theory** provides the mathematical framework for representing and analyzing networks of interconnected data, from the structure of a Neural Network to the relationships in a social media dataset.
+
+## 1. What is a Graph?
+
+A graph $G = (V, E)$ consists of two sets:
+* **Vertices (Nodes) $V$:** The entities or points in the network (e.g., users, neurons, cities).
+* **Edges $E$:** The connections between the nodes (e.g., friendships, synaptic weights, roads).
+
+## 2. Types of Graphs
+
+The nature of the relationship determines the type of graph used:
+
+| Type | Description | ML Application |
+| :--- | :--- | :--- |
+| **Undirected** | Edges have no direction (A-B is same as B-A). | Collaborative Filtering (User-Item similarity). |
+| **Directed (Digraph)** | Edges point from one node to another ($A \to B$). | **Neural Networks** (Information flows forward). |
+| **Weighted** | Edges have numerical values assigned to them. | **Weights in a Neural Network** or distances. |
+| **Cyclic / Acyclic** | Whether you can follow edges to return to a start node. | **Directed Acyclic Graphs (DAGs)** are used in computation pipelines. |
+
+## 3. Representing Graphs Mathematically
+
+To process graphs with algorithms, we must represent them as numbers or matrices.
+
+### A. Adjacency Matrix
+A square matrix where the entry $A_{ij}$ is 1 if there is an edge between node $i$ and node $j$, and 0 otherwise.
+
+* **Symmetric:** For undirected graphs.
+* **Asymmetric:** For directed graphs.
+
+### B. Adjacency List
+A collection of lists where each node has a list of the other nodes it is connected to. This is more memory-efficient for **sparse graphs** (where most nodes aren't connected).
+
+## 4. Graph Theory in Machine Learning
+
+### A. Neural Network Architecture
+A Neural Network is a directed, weighted graph. The neurons are nodes, and the weights are the directed edges. Training the network is essentially updating the weights (edge values) of this graph.
+
+### B. Knowledge Graphs
+Companies like Google and Meta use Knowledge Graphs to store facts about the world. Entities (like "Albert Einstein") are nodes, and relationships (like "Born In") are edges. This allows for advanced reasoning and semantic search.
+
+### C. Graph Neural Networks (GNNs)
+GNNs are a class of deep learning models designed to perform inference on data described by graphs. They are used for:
+* **Molecular Discovery:** Atoms are nodes, bonds are edges.
+* **Fraud Detection:** Detecting suspicious patterns in transaction networks.
+* **Recommendation Systems:** Predicting new edges (purchases) between User nodes and Item nodes.
+
+## 5. Key Graph Algorithms
+
+* **Shortest Path (Dijkstra’s):** Used in routing and logistics.
+* **PageRank:** The original algorithm behind Google Search, which ranks nodes based on their "importance" in the network.
+* **Community Detection:** Finding clusters of nodes that are more densely connected to each other than to the rest of the network (Clustering).
+
+---
+
+This concludes our module on Discrete Mathematics. You now have the tools for logic, counting, and networking. Next, we enter the final and most critical pillar of ML mathematics: Probability and Statistics.

docs/machine-learning/mathematics-for-ml/discrete-mathematics/logic.mdx

@@ -0,0 +1,71 @@
+---
+title: "Logic and Boolean Algebra"
+sidebar_label: Logic
+description: "Exploring propositional logic, logical operators, and Boolean algebra as the basis for decision-making algorithms and binary classification."
+tags: [logic, boolean-algebra, discrete-math, truth-tables, decision-trees, binary-logic]
+---
+
+At the most granular level, computers and Machine Learning algorithms operate on **Logic**. Whether it's a Decision Tree splitting data based on a condition or a Neural Network using a step function, **Propositional Logic** and **Boolean Algebra** are the tools used to formalize these decisions.
+
+## 1. Propositional Logic
+
+A **proposition** is a declarative statement that is either **True (T)** or **False (F)**. In ML, we often use propositions to evaluate features.
+
+* **Example Proposition ($P$):** "The house has more than 3 bedrooms."
+* **Example Proposition ($Q$):** "The price is less than $500,000."
+
+### Logical Operators
+We combine propositions using logical operators to create complex decision boundaries.
+
+| Operator | Symbol | Meaning | ML Context |
+| :--- | :--- | :--- | :--- |
+| **AND** | $\land$ | Both must be true. | Feature A > 10 **AND** Feature B < 5. |
+| **OR** | $\lor$ | At least one must be true. | If Category is "Dog" **OR** "Cat", then "Pet". |
+| **NOT** | $\neg$ | Reverses the value. | If **NOT** (Missing Value). |
+| **XOR** | $\oplus$ | Exactly one is true. | Binary features that are mutually exclusive. |
+
+## 2. Truth Tables
+
+A truth table lists all possible combinations of inputs and the resulting output. This is the simplest way to visualize a discrete function.
+
+**Example: The AND ($\land$) Operator**
+
+| $P$ | $Q$ | $P \land Q$ |
+| :--- | :--- | :--- |
+| T | T | **T** |
+| T | F | F |
+| F | T | F |
+| F | F | F |
+
+## 3. Boolean Algebra in Machine Learning
+
+Boolean Algebra is the branch of mathematics that deals with variables that have two values: $\{0, 1\}$.
+
+### A. Binary Classification
+In binary classification, our target variable $y$ is a Boolean. We use logic to determine the threshold:
+If $P(\text{Class}=1) > 0.5$, then **True**, else **False**.
+
+### B. Decision Trees
+Decision Trees are essentially a nested series of logical "IF-THEN-ELSE" statements. Each node in the tree evaluates a logical proposition to route the data down the correct branch.
+
+### C. Logic Gates in Neural Networks
+Early models of artificial neurons (the McCulloch-Pitts neuron) were designed to mimic logic gates. By adjusting weights and thresholds, a single neuron can be made to act as an AND gate or an OR gate.
+
+## 4. Conditional and Bi-conditional Logic
+
+* **Implication ($P \implies Q$):** "If $P$, then $Q$." This forms the basis of Rule-Based Systems and Expert Systems.
+* **Equivalence ($P \iff Q$):** "$P$ if and only if $Q$." This is used to define identical behaviors in different models.
+
+:::tip Logic and Regularization
+In some forms of logic-based learning, we use **Inductive Logic Programming (ILP)** to learn formal rules from data, rather than just adjusting numerical weights.
+:::
+
+## 5. Boolean Minimization
+In large-scale systems, we use Boolean Algebra laws (like De Morgan's Laws) to simplify complex logical expressions. This is similar to how we optimize code or simplify mathematical models to make them more efficient.
+
+* **De Morgan's Law 1:** $\neg(P \land Q) \iff (\neg P \lor \neg Q)$
+* **De Morgan's Law 2:** $\neg(P \lor Q) \iff (\neg P \land \neg Q)$
+
+---
+
+Now that we understand sets and the logic to navigate them, we can explore Graph Theory, which is how we model complex relationships and networks.

docs/machine-learning/mathematics-for-ml/discrete-mathematics/sets-and-relations.mdx

@@ -0,0 +1,75 @@
+---
+title: "Sets and Relations"
+sidebar_label: Sets & Relations
+description: "Exploring the fundamentals of Set Theory and Relations, and how these discrete structures underpin data categorization and recommendation systems in Machine Learning."
+tags: [discrete-math, sets, relations, mathematics-for-ml, logic, data-structures]
+---
+
+Discrete Mathematics deals with distinct, separated values rather than continuous ranges. **Set Theory** is the language we use to group these values, and **Relations** describe how these groups interact. In Machine Learning, these concepts are vital for everything from defining probability spaces to building database schemas for training data.
+
+## 1. Set Theory Fundamentals
+
+A **Set** is an unordered collection of distinct objects, called elements.
+
+### Notation
+* $A = \{1, 2, 3\}$ : A set containing numbers 1, 2, and 3.
+* $x \in A$ : $x$ is an element of set $A$.
+* $\emptyset$ : An empty set.
+* $\mathbb{R}, \mathbb{Z}, \mathbb{N}$ : Sets of Real numbers, Integers, and Natural numbers.
+
+:::tip Common Sets in ML
+* **$\mathbb{R}$ (Real Numbers):** Used for continuous features like height, price, or weight.
+* **$\mathbb{Z}$ (Integers):** Used for count-based data (e.g., number of clicks).
+* **$\{0, 1\}$ (Binary Set):** The standard output set for binary classification.
+* **$\{C_1, C_2, \dots, C_k\}$ (Categorical Set):** The labels for multi-class classification.
+:::
+
+### Key Operations
+The interaction between sets is often visualized using **Venn Diagrams**.
+
+* **Union ($A \cup B$):** Elements in $A$, or $B$, or both. (Equivalent to a logical `OR`).
+* **Intersection ($A \cap B$):** Elements present in both $A$ and $B$. (Equivalent to a logical `AND`).
+* **Difference ($A \setminus B$):** Elements in $A$ that are not in $B$.
+* **Complement ($A^c$):** Everything in the universal set that is *not* in $A$.
+
+:::tip Sets in ML
+In classification tasks, the **Label Space** is a set. For a cat/dog classifier, the set of possible outputs is $Y = \{\text{Cat}, \text{Dog}\}$. When evaluating models, we often look at the **Intersection** of predicted labels and true labels to calculate accuracy.
+:::
+
+## 2. Cartesian Products
+
+The Cartesian Product of two sets $A$ and $B$, denoted $A \times B$, is the set of all possible ordered pairs $(a, b)$.
+
+$$
+A \times B = \{ (a, b) \mid a \in A \text{ and } b \in B \}
+$$
+
+If $A$ represents "Users" and $B$ represents "Movies," $A \times B$ represents every possible interaction between every user and every movie. This is the foundation of **Utility Matrices** in Recommender Systems.
+
+## 3. Relations
+
+A **Relation** $R$ from set $A$ to set $B$ is simply a subset of the Cartesian product $A \times B$. It defines a relationship between elements of the two sets.
+
+### Types of Relations
+In ML, we specifically look for certain properties in relations:
+* **Reflexive:** Every element is related to itself.
+* **Symmetric:** If $a$ is related to $b$, then $b$ is related to $a$ (e.g., "Similarity" in clustering).
+* **Transitive:** If $a \to b$ and $b \to c$, then $a \to c$.
+
+### Binary Relations and Graphs
+Relations are often represented as **Directed Graphs**. If $(a, b) \in R$, we draw an arrow from node $a$ to node $b$.
+
+## 4. Why this matters in Machine Learning
+
+### A. Data Preprocessing
+When we perform "One-Hot Encoding" or handle categorical variables, we are mapping elements from a discrete set of categories into a numerical space.
+
+### B. Knowledge Graphs
+Modern AI often uses **Knowledge Graphs** (like those powering Google Search). These are massive sets of entities connected by relations (e.g., `(Paris, is_capital_of, France)`).
+
+### C. Formal Logic in AI
+Sets and relations form the basis of predicate logic, which is used in "Symbolic AI" and for defining constraints in optimization problems.
+
+---
+
+Now that we can group objects into sets and relate them, we need to understand the logic that allows us to make valid inferences from these groups.