multivariate adaptive regression splines

classic Classic list List threaded Threaded
13 messages Options
Reply | Threaded
Open this post in threaded view
|

multivariate adaptive regression splines

alkunany
Hey Everyone
Kindly I am wondering whether I can find out package of multivariate
adaptive regression splines  in weka or any alternative algorithm for it in
weka ?
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

Eibe Frank-3
MARS is not available natively in WEKA, but you can use the R implementation of MARS through WEKA by installing the RPlugin package for WEKA.

Once installed, you can run MLRClassifier and select regr.mars (or regr.earth, which provides an alternative implementation).

More info is in the following videos:
Slides are available via the link on the following page:

https://www.cs.waikato.ac.nz/ml/weka/mooc/advanceddataminingwithweka/

Cheers,
Eibe

On Mon, Feb 12, 2018 at 8:17 PM, alkunany <[hidden email]> wrote:
Hey Everyone
Kindly I am wondering whether I can find out package of multivariate
adaptive regression splines  in weka or any alternative algorithm for it in
weka ?
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

alkunany
Dear Eibe
I have followed the video and installed Rplug package correctly, but I  have
faced problem which is every time when I try to open classify window , It
shows please wait while R package are being  installed. at end I cant use
MLR .
Please what I have to do in this case ?
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

alkunany
In reply to this post by Eibe Frank-3
Dear Eibe
I have solve the installation issue but I have face another issue which is
nonactive  start button as in attached picture , so I can make run for the
classifier could you please help me in this ?
Thanks  <http://weka.8497.n7.nabble.com/file/t6055/Capture.jpg>



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

Eibe Frank-2
Administrator
Great to hear you made the installation work.

Normally, the Start button is greyed out if a classifier is not capable of processing the data (e.g., because it has string attributes). In that case, you need to use the FilteredClassifier in conjunction with an appropriate filter (e.g., StringToWordVector) to preprocess the data before it is passed to MLRClassifier.

Cheers,
Eibe

> On 13/02/2018, at 10:02 PM, alkunany <[hidden email]> wrote:
>
> Dear Eibe
> I have solve the installation issue but I have face another issue which is
> nonactive  start button as in attached picture , so I can make run for the
> classifier could you please help me in this ?
> Thanks  <http://weka.8497.n7.nabble.com/file/t6055/Capture.jpg>
>
>
>
> --
> Sent from: http://weka.8497.n7.nabble.com/
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

alkunany
Dear Eibe
I have fixed the Start button is grayed out issue .
However , MARS has used with nominal attributes such as in example in the
link . Does there any different between weka and R packages ?

https://qizeresearch.wordpress.com/2013/12/04/a-short-example-of-multivariate-adaptive-regression-splines-mars/

Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

Eibe Frank-2
Administrator
I just tried regr.earth on a dataset with nominal predictor attributes and it works fine.

On the other hand, regr.mars does not seem to be able to process nominal attributes. This is not something we can change in WEKA because it depends on MLR and the underlying R code.

Cheers,
Eibe

> On 15/02/2018, at 6:32 PM, alkunany <[hidden email]> wrote:
>
> Dear Eibe
> I have fixed the Start button is grayed out issue .
> However , MARS has used with nominal attributes such as in example in the
> link . Does there any different between weka and R packages ?
>
> https://qizeresearch.wordpress.com/2013/12/04/a-short-example-of-multivariate-adaptive-regression-splines-mars/
>
> Thanks
>
>
>
> --
> Sent from: http://weka.8497.n7.nabble.com/
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

alkunany
Dear Eibe
I am happy to hear that however I have removed Rplug and now I am facing
package manger problem it is not work I have tried to remove  the file
installedPackageCache.ser but the problem is still there.
Please any other solution ?
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

Eibe Frank-3
The package manager issue is probably due to the fact that SourceForge moved some files to another data center. Try again now. It seems like the packages are back in places now.

Cheers,
Eibe

On Fri, Feb 16, 2018 at 12:17 PM, alkunany <[hidden email]> wrote:
Dear Eibe
I am happy to hear that however I have removed Rplug and now I am facing
package manger problem it is not work I have tried to remove  the file
installedPackageCache.ser but the problem is still there.
Please any other solution ?
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

alkunany
Hi Eibe
I have tried again , however the problem is still so far.
http://weka.sourceforge.net/doc.stable/
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

Eibe Frank-3
It seems to be back up now! I just tried it and got the Javadoc. The package manager also seems to work again.

Cheers,
Eibe

On Sun, Feb 18, 2018 at 12:22 PM, alkunany <[hidden email]> wrote:
Hi Eibe
I have tried again , however the problem is still so far.
http://weka.sourceforge.net/doc.stable/
Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

alkunany
Dear Eibe
Every thing is fine now, however how can I display the result such as in R
                 coefficients
(Intercept)            0.4400
housingyes            -0.0401
loanyes               -0.0294
contactunknown        -0.0717
monthdec               0.1885
monthjun               0.0513
monthmar               0.3295
monthoct               0.1922
monthsep               0.1777
poutcomesuccess        0.3807
h(age-27)              0.0199
h(54-age)              0.0210
h(age-54)             -0.0137
h(duration-375)        0.0003
h(1080-duration)      -0.0004
h(duration-1080)      -0.0004
h(2-campaign)          0.0266
h(pdays-53)           -0.0020
h(349-pdays)          -0.0016
h(pdays-349)           0.0061
h(pdays-425)          -0.0044

Selected 21 of 22 terms, and 13 of 42 predictors
Termination condition: RSq changed by less than 0.001 at 22 terms
Importance: duration, poutcomesuccess, monthmar, housingyes, monthoct,
contactunknown, monthsep, age, ...
Number of terms at each degree of interaction: 1 20 (additive model)
GCV 0.0707  RSS 3189  GRSq 0.316  RSq 0.317  CVRSq 0.315

Note: the cross-validation sd's below are standard deviations across folds

Cross validation:   nterms 23.90 sd 2.18    nvars 15.50 sd 2.07

     CVRSq    sd     ClassRate    sd     MaxErr   sd
     0.315 0.025         0.901 0.005      -1.36 1.14.

Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|

Re: multivariate adaptive regression splines

Eibe Frank-3
It looks like this information is not returned by the MLR wrapper for earth.

You can get some information on the model by using the trace parameter, but it does not show the final model in a succinct form. You can try

  trace = 2

as learnerParams in the MLRClassifier.

Cheers,
Eibe

On Mon, Feb 19, 2018 at 11:12 PM, alkunany <[hidden email]> wrote:
Dear Eibe
Every thing is fine now, however how can I display the result such as in R
                 coefficients
(Intercept)            0.4400
housingyes            -0.0401
loanyes               -0.0294
contactunknown        -0.0717
monthdec               0.1885
monthjun               0.0513
monthmar               0.3295
monthoct               0.1922
monthsep               0.1777
poutcomesuccess        0.3807
h(age-27)              0.0199
h(54-age)              0.0210
h(age-54)             -0.0137
h(duration-375)        0.0003
h(1080-duration)      -0.0004
h(duration-1080)      -0.0004
h(2-campaign)          0.0266
h(pdays-53)           -0.0020
h(349-pdays)          -0.0016
h(pdays-349)           0.0061
h(pdays-425)          -0.0044

Selected 21 of 22 terms, and 13 of 42 predictors
Termination condition: RSq changed by less than 0.001 at 22 terms
Importance: duration, poutcomesuccess, monthmar, housingyes, monthoct,
contactunknown, monthsep, age, ...
Number of terms at each degree of interaction: 1 20 (additive model)
GCV 0.0707  RSS 3189  GRSq 0.316  RSq 0.317  CVRSq 0.315

Note: the cross-validation sd's below are standard deviations across folds

Cross validation:   nterms 23.90 sd 2.18    nvars 15.50 sd 2.07

     CVRSq    sd     ClassRate    sd     MaxErr   sd
     0.315 0.025         0.901 0.005      -1.36 1.14.

Thanks



--
Sent from: http://weka.8497.n7.nabble.com/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html