Stacking on Numeric Data Sets

As is human nature we always want to get a better prediction , if possible some would pray for a full 100%.

Anyways ignoring the Hypothetical, We have run a number of common models like

1)Logistic Regression

2)Random Forest

3)SVM

so now the question arises, whether we can give it a tad bit push for a better accuracy?

Well the answer is we still have one trick left , How? well Stacking

What in stacking?

well we will try stacking a Random forest on Logistic

and vice versa.

You can find the code for it here ->

https://github.com/mmd52/UCI_ADULT_DATSET_MODELS_RUN/blob/master/Stackers.R

If you see the code you see accuracy has not quite increased.

Well if you understood the above , then whats stopping you from trying to stack SVM on logistic or random forest.

Try it and let me know the results

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s