Siksha Sarovar

Siksha Sarovar (sikshasarovar.com) is a free educational web application that helps students in India learn programming and prepare for academic and competitive exams. The platform offers structured coding courses (C, C++, Python, Java, HTML, CSS, PHP, Power BI, AI, Machine Learning, Data Science), complete university curriculum notes for BCA/MCA students with previous year question papers, Class 10 and Class 12 CBSE/HBSE school notes, and dedicated preparation material for SSC, UPSC, Banking, Railway and other government exams. Browsing the site is completely free and requires no account. Users may optionally sign in with Google solely to save their learning progress, quiz scores and personal preferences across devices.

Privacy Policy | Terms of Service | Contact Siksha Sarovar | About Siksha Sarovar

v4.0.9 · PWA
Siksha Sarovar logo
Siksha Sarovar
Your Learning Universe

Siksha Sarovar is a free e-learning platform for coding courses, BCA university notes and competitive exam preparation. Optional Google sign-in saves your learning progress across devices.

Initializing knowledge base…
Compiling modules 0%

Unit 3 — Learning from Examples (Induction)

Lesson 28 of 34 in the free Artificial Intelligence notes on Siksha Sarovar, written by Rohit Jangra.

Learning from Examples — Induction

Inductive learning builds a general rule or concept description from a set of labelled training examples — it is the classical ancestor of nearly all modern supervised machine learning.

The Inductive Learning Setup

TermMeaning
Positive exampleAn instance known to belong to the concept being learned
Negative exampleAn instance known not to belong to the concept
HypothesisThe general rule the algorithm outputs, meant to correctly classify both seen and future examples
GeneralisationExtending the hypothesis to cover examples beyond exactly those given
SpecialisationNarrowing the hypothesis so it stops covering an incorrectly included case

Worked Example: Learning "What Is an Arch"

ExampleDescriptionClass
1Two upright blocks + one flat block on top, no touching sidesPositive (Arch)
2Two upright blocks touching each other + flat block on topNegative (not an Arch — sides touch)
3Two upright blocks (not touching) + flat block on top, different coloursPositive (Arch)

From these, the algorithm induces: an arch is two non-touching upright supports with a flat block resting on top; colour is irrelevant. Example 3 forces the generalisation that colour doesn't matter; Example 2 forces the specialisation that the supports must not touch.

Candidate Elimination — Version Space

One classical algorithm maintains two boundaries in the space of possible hypotheses:

BoundaryMeaning
S (specific boundary)The most specific hypotheses consistent with all examples so far
G (general boundary)The most general hypotheses consistent with all examples so far

Each new positive example generalises S (if needed) so it still covers the example; each new negative example specialises G (if needed) so it stops covering the example. The true target concept is guaranteed to lie between S and G.

Types of Inductive Learning

TypeDescription
Concept learningLearning a Boolean (yes/no) classification rule, e.g., "is this an arch?"
Learning by generalisationBroadening a rule to cover more positive cases
Learning by specialisationNarrowing a rule to exclude negative cases wrongly included
Decision-tree inductionBuilding a tree of attribute tests that splits examples into their classes (e.g., ID3 algorithm)

Strengths and Limitations

StrengthsLimitations
Requires no hand-written domain theory — learns purely from labelled dataNeeds a reasonably large, representative set of examples
General-purpose — the same technique applies across very different conceptsSensitive to noisy or mislabelled examples
Foundation for modern supervised ML (decision trees, SVMs, neural nets)Can overfit to peculiarities of the training examples if not careful