GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — python-machine-learning-book/faq/num-support-vectors.md at master · GS-/python-machine-learning-book

Expand file tree

/

num-support-vectors.md

Copy path
More file actions
More file actions

Latest commit

 

History

History
History
9 lines (4 loc) · 938 Bytes
/

num-support-vectors.md

Copy path

File metadata and controls

9 lines (4 loc) · 938 Bytes
Raw
Copy raw file
Download raw file
Edit and raw actions

When training an SVM classifier, is it better to have a large or small number of support vectors?

Unfortunately, like so often in machine learning applications, it really depends on the dataset. If we train an RBF kernel SVM, we will typically end up with more support vectors than in a linear model. If our data is linearly separable, the latter may be better, and if that's not the case, the former may be better.

Also, we have to differentiate between computational efficiency and generalization performance. If we increase the number of support vectors, our classification becomes more "expensive", especially in kernel SVM where we have to recalculate the distances between every new sample and the entire training set.

I'd say the best way to tackle the predictive performance problem is simply to evaluate the model, plot learning curves, do k-fold and/or cross validation, and see what works best on our given dataset.

You are visitor 01402520 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.