Skip to content

Commit

Permalink
naive bayes boundary
Browse files Browse the repository at this point in the history
  • Loading branch information
rasbt committed Nov 9, 2015
1 parent 99c401d commit 7040f39
Show file tree
Hide file tree
Showing 5 changed files with 15 additions and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,7 @@ Excerpts from the [Foreword](./docs/foreword_ro.pdf) and [Preface](./docs/prefac
- [What is Euclidean distance in terms of machine learning?](./faq/euclidean-distance.md)
- [What is the major difference between naive Bayes and logistic regression?](./faq/naive-bayes-vs-logistic-regression.md)
- [When should I apply data normalization/standardization?](./faq/when-to-standardize.md)
- [What is the decision boundary for Naive Bayes?](./faq/naive-bayes-boundary.md)
- [Which machine learning algorithms can be considered as among the best?](./faq/best-ml-algo.md)
- [What are the broad categories of classifiers?](./faq/classifier-categories.md)

Expand Down
1 change: 1 addition & 0 deletions faq/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,7 @@ Sebastian
- [What is Euclidean distance in terms of machine learning?](./euclidean-distance.md)
- [What is the major difference between naive Bayes and logistic regression?](./naive-bayes-vs-logistic-regression.md)
- [When should I apply data normalization/standardization?](./when-to-standardize.md)
- [What is the decision boundary for Naive Bayes?](./naive-bayes-boundary.md)
- [Which machine learning algorithms can be considered as among the best?](./best-ml-algo.md)
- [What are the broad categories of classifiers?](./classifier-categories.md)

Expand Down
13 changes: 13 additions & 0 deletions faq/naive-bayes-boundary.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# What is the decision boundary for Naive Bayes?


It's a (piecewise) quadratic decision boundary for the Gaussian model. The multinomial model has a linear boundary.
Below, I plotted some examples:

1) UCI Wine Dataset

![](./naive-bayes-boundary/gaussian_1.png)

2) An XOR toy dataset

![](./naive-bayes-boundary/gaussian_2.png)
Binary file added faq/naive-bayes-boundary/gaussian_1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added faq/naive-bayes-boundary/gaussian_2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 7040f39

Please sign in to comment.