What is Naive Bayes Classifier?

A Naive Bayes classifier is a way to use math to identify something. For instance, you see something on the playground that is red. It could be a playground ball, or maybe a rabbit, or a tennis ball – but it’s probably not a rabbit or tennis ball because you’ve never seen a red one of those before.

A fellow named Thomas Bayes figured out that if you actually knew how often playground balls, rabbits, and tennis balls were red, you could use math to work out a number that says how often a red thing that you see is a playground ball, rabbit, or tennis ball. Pretty neat. Maybe you notice other things about what you see too: it’s size, shape, whatever. Well, Bayes’ rule works even when you have more than one way to describe what you’re looking at.

A Bayes Classifier is, then, something that uses Bayes rules to figure out how often red things are playground balls, how often they are rabbits, and how often they are tennis balls and then picks the one that happens most often. If most playground balls are red, and most rabbits and tennis balls are not, then when you see something that’s red, it’s probably a playground ball.

A Naive Bayes Classifier is one where you have several things that describe what you are looking at, like it’s color, size, whether it has eyes or not, and you assume that they have nothing to do with each other. In this scenario, the color of something has nothing to do with its size or whether it has eyes or not.