SlideShare a Scribd company logo
Theory of Computation
Introduction
From high level
• From a high level what this course is about?
– Given a set, say S.
– Let 𝐴 ⊆ 𝑆.
– Both S and A are well defined.
– We are given an element 𝑥 ∈ 𝑆, and asked to find
whether this 𝑥 is in 𝐴 or not.
– That’s all !
Surprises !!
• Surprising things
– This is related to decision problems.
• S is set all face images. A is set of images of a particular
person. {Face verification}
• S is set of all graphs. A is set of graphs with Hamiltonian
cycle.
– Sometimes this is an unsolvable problem. ??
– Sometimes this is an easy task, sometimes quite a
difficult one.
• Recall, 𝑂 𝑛2 is time consuming than 𝑂(𝑛) algorithm.
We want general enough set
• Set of strings over some alphabet like {0,1}.
• For example set of strings that end with a 0,
{0, 00, 10, 000, 010, 100, 110, …}
• Eg2: Each string in the set can be seen as a
positive binary number and let the set be the
set of prime numbers.
– Given a number (binary string of 0s and 1s) you
want to find whether this is in the set (prime) or
not (not a prime).
Why strings are chosen?
• Any data element like number or image or any
thing can be represented as a string.
– Can we say DNA code represents a human being?
• Even a method which solves a problem can be
represented as a string.
• A proof can be represented as a string.
• So strings over an alphabet gives us power to
represent the things… that is we have
languages of strings to represent the things.
Theory of Introduction in Computer Science
Syllabus
• Syllabus:
• Unit – 1 [8 Hours]: Introduction - Alphabets, Strings and Languages, Automata and Grammars; Deterministic finite
Automata (DFA) - Formal Definition, Simplified notation, State transition graph, Transition table, Language of DFA;
Nondeterministic finite Automata (NFA) - NFA with epsilon transition, Language of NFA, Equivalence of NFA and
DFA, Minimization of Finite Automata, Distinguishing one string from other
•
Unit – 2 [8 Hours]: Regular Expression (RE) - Definition, Operators of regular expression and their precedence,
Algebraic laws for Regular expressions; Relation with FA - Regular expression to FA, DFA to Regular expression; Non
Regular Languages - Pumping Lemma for regular Languages, Application of Pumping Lemma; Properties - Closure
properties of Regular Languages, Decision properties of Regular Languages, Applications and Limitation of FA
•
Unit – 3 [8 Hours]: Context Free Grammar (CFG) - Definition, Examples, Derivation, Derivation trees; Ambiguity in
Grammar - Inherent ambiguity, Ambiguous to Unambiguous CFG; Normal forms for CFGs - Useless symbols,
Simplification of CFGs, CNF and GNF; Context Free Languages (CFL) - Closure properties of CFLs, Decision
Properties of CFLs, Emptiness, Finiteness and Membership, Pumping lemma for CFLs
•
Unit – 4 [8 Hours]: Push Down Automata (PDA) - Description and definition, Instantaneous Description, Language
of PDA; Variations of PDA - Acceptance by Final state, Acceptance by empty stack, Deterministic PDA; Equivalence
of PDA and CFG - CFG to PDA and PDA to CFG
•
Unit – 5 [8 Hours]: Turing machines (TM) - Basic model, definition and representation, Instantaneous Description;
Variants of Turing Machine - TM as Computer of Integer functions, Universal TM; Church’s Thesis; Language
acceptance by TM - Recursive and recursively enumerable languages;
•
Unit – 6 [8 Hours]: Decidability - Halting problem, Introduction to Undecidability, Undecidable problems about
TMs; Complexity - Time Complexity, Problem classes - P, NP, NP-Hard, NP-Complete.
Text Books
Text Books:
• John E. Hopcroft, Rajeev Motwani and Jeffrey D. Ullman, Introduction to Automata
Theory, Languages and Computation, Pearson Education, 3rd edition, 2014, ISBN:
978-0321455369
• Michael Sipser, Introduction to the Theory of Computation, Cengage Learning, 3rd
Edition, 2014, ISBN: 978-8131525296
Reference Books:
• John C. Martin, Introduction to Languages and the Theory of Computation,
McGraw-Hill Education, 4th edition, 2010, ISBN: 978-0073191461
• Bernard M. Moret, The Theory of Computation, Pearson Education, 2002, ISBN:
978-8131708705
Evaluation
• Quiz: Best (n-1) 20 marks
• Mid1: 20 marks
• Mid2: 25 marks
• Endsem: 35 marks
• Can be updated (and will be informed).

More Related Content

PDF
TOC in 8 hours.pdfvdvbnnhgfsxcvbmnvxsdfvb
PDF
Introduction to the theory of computation
PPT
1. Introduction to __Automata Theory.ppt
PPTX
Language models
PDF
Adnan: Introduction to Natural Language Processing
PPTX
Artificial Intelligence Notes Unit 4
PPT
TOC in 8 hours.pdfvdvbnnhgfsxcvbmnvxsdfvb
Introduction to the theory of computation
1. Introduction to __Automata Theory.ppt
Language models
Adnan: Introduction to Natural Language Processing
Artificial Intelligence Notes Unit 4

Similar to Theory of Introduction in Computer Science (20)

PDF
Probability Theory Application and statitics
DOC
Toc syllabus updated
PPT
PPTX
pptphrase-tagset-mapping-for-french-and-english-treebanks-and-its-application...
PPTX
Pptphrase tagset mapping for french and english treebanks and its application...
PDF
Fafl notes [2010] (sjbit)
PPTX
Regular-expressions in NLP and regular expression with example
PPTX
Introduction to Theory of computations:-
PPTX
Theory of computation anna University ppt
PPTX
Presentation.TOA.pptxjiihugydrawagkjiggkfgtsed
PPT
2009 CSBB LAB 新生訓練
DOC
Flat notes iii i (1)(7-9-20)
PPT
haenelt.ppt
PPTX
Lecture 1 of automata theory where .pptx
PPTX
Knowledge & logic in Artificial Intelligence.pptx
PPT
Natural Language Processing: N-Gram Language Models
PPT
N GRAM FOR NATURAL LANGUGAE PROCESSINGG
PPT
Natural Language Processing: N-Gram Language Models
PPTX
PNP.pptx
PPTX
Probability Theory Application and statitics
Toc syllabus updated
pptphrase-tagset-mapping-for-french-and-english-treebanks-and-its-application...
Pptphrase tagset mapping for french and english treebanks and its application...
Fafl notes [2010] (sjbit)
Regular-expressions in NLP and regular expression with example
Introduction to Theory of computations:-
Theory of computation anna University ppt
Presentation.TOA.pptxjiihugydrawagkjiggkfgtsed
2009 CSBB LAB 新生訓練
Flat notes iii i (1)(7-9-20)
haenelt.ppt
Lecture 1 of automata theory where .pptx
Knowledge & logic in Artificial Intelligence.pptx
Natural Language Processing: N-Gram Language Models
N GRAM FOR NATURAL LANGUGAE PROCESSINGG
Natural Language Processing: N-Gram Language Models
PNP.pptx
Ad

Recently uploaded (20)

PPTX
web development for engineering and engineering
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PPTX
CH1 Production IntroductoryConcepts.pptx
PDF
Digital Logic Computer Design lecture notes
PDF
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
PPTX
Welding lecture in detail for understanding
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PDF
PPT on Performance Review to get promotions
PPT
Project quality management in manufacturing
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PPTX
additive manufacturing of ss316l using mig welding
PPTX
OOP with Java - Java Introduction (Basics)
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
web development for engineering and engineering
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
CH1 Production IntroductoryConcepts.pptx
Digital Logic Computer Design lecture notes
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
Welding lecture in detail for understanding
bas. eng. economics group 4 presentation 1.pptx
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPT on Performance Review to get promotions
Project quality management in manufacturing
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
additive manufacturing of ss316l using mig welding
OOP with Java - Java Introduction (Basics)
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
Ad

Theory of Introduction in Computer Science

  • 2. From high level • From a high level what this course is about? – Given a set, say S. – Let 𝐴 ⊆ 𝑆. – Both S and A are well defined. – We are given an element 𝑥 ∈ 𝑆, and asked to find whether this 𝑥 is in 𝐴 or not. – That’s all !
  • 3. Surprises !! • Surprising things – This is related to decision problems. • S is set all face images. A is set of images of a particular person. {Face verification} • S is set of all graphs. A is set of graphs with Hamiltonian cycle. – Sometimes this is an unsolvable problem. ?? – Sometimes this is an easy task, sometimes quite a difficult one. • Recall, 𝑂 𝑛2 is time consuming than 𝑂(𝑛) algorithm.
  • 4. We want general enough set • Set of strings over some alphabet like {0,1}. • For example set of strings that end with a 0, {0, 00, 10, 000, 010, 100, 110, …} • Eg2: Each string in the set can be seen as a positive binary number and let the set be the set of prime numbers. – Given a number (binary string of 0s and 1s) you want to find whether this is in the set (prime) or not (not a prime).
  • 5. Why strings are chosen? • Any data element like number or image or any thing can be represented as a string. – Can we say DNA code represents a human being? • Even a method which solves a problem can be represented as a string. • A proof can be represented as a string. • So strings over an alphabet gives us power to represent the things… that is we have languages of strings to represent the things.
  • 7. Syllabus • Syllabus: • Unit – 1 [8 Hours]: Introduction - Alphabets, Strings and Languages, Automata and Grammars; Deterministic finite Automata (DFA) - Formal Definition, Simplified notation, State transition graph, Transition table, Language of DFA; Nondeterministic finite Automata (NFA) - NFA with epsilon transition, Language of NFA, Equivalence of NFA and DFA, Minimization of Finite Automata, Distinguishing one string from other • Unit – 2 [8 Hours]: Regular Expression (RE) - Definition, Operators of regular expression and their precedence, Algebraic laws for Regular expressions; Relation with FA - Regular expression to FA, DFA to Regular expression; Non Regular Languages - Pumping Lemma for regular Languages, Application of Pumping Lemma; Properties - Closure properties of Regular Languages, Decision properties of Regular Languages, Applications and Limitation of FA • Unit – 3 [8 Hours]: Context Free Grammar (CFG) - Definition, Examples, Derivation, Derivation trees; Ambiguity in Grammar - Inherent ambiguity, Ambiguous to Unambiguous CFG; Normal forms for CFGs - Useless symbols, Simplification of CFGs, CNF and GNF; Context Free Languages (CFL) - Closure properties of CFLs, Decision Properties of CFLs, Emptiness, Finiteness and Membership, Pumping lemma for CFLs • Unit – 4 [8 Hours]: Push Down Automata (PDA) - Description and definition, Instantaneous Description, Language of PDA; Variations of PDA - Acceptance by Final state, Acceptance by empty stack, Deterministic PDA; Equivalence of PDA and CFG - CFG to PDA and PDA to CFG • Unit – 5 [8 Hours]: Turing machines (TM) - Basic model, definition and representation, Instantaneous Description; Variants of Turing Machine - TM as Computer of Integer functions, Universal TM; Church’s Thesis; Language acceptance by TM - Recursive and recursively enumerable languages; • Unit – 6 [8 Hours]: Decidability - Halting problem, Introduction to Undecidability, Undecidable problems about TMs; Complexity - Time Complexity, Problem classes - P, NP, NP-Hard, NP-Complete.
  • 8. Text Books Text Books: • John E. Hopcroft, Rajeev Motwani and Jeffrey D. Ullman, Introduction to Automata Theory, Languages and Computation, Pearson Education, 3rd edition, 2014, ISBN: 978-0321455369 • Michael Sipser, Introduction to the Theory of Computation, Cengage Learning, 3rd Edition, 2014, ISBN: 978-8131525296 Reference Books: • John C. Martin, Introduction to Languages and the Theory of Computation, McGraw-Hill Education, 4th edition, 2010, ISBN: 978-0073191461 • Bernard M. Moret, The Theory of Computation, Pearson Education, 2002, ISBN: 978-8131708705
  • 9. Evaluation • Quiz: Best (n-1) 20 marks • Mid1: 20 marks • Mid2: 25 marks • Endsem: 35 marks • Can be updated (and will be informed).