Weka Explorer freeze in Windows 34gb memory

classic Classic list List threaded Threaded
25 messages Options
12
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Weka Explorer freeze in Windows 34gb memory

Jenna
I am running weka Explorer in the cloud (Google Cloud) on Windows with a 34gb memory and 6 cpus.
The dataset is about 125mb, has 1000 features and about 30,000 rows.
Sometimes, mostly when doing feature selection, the program will run, the little Weka bird at bottom right of the screen will stop moving after a certain period of time (say 1 minute), the Start button will become available, but in the status bar at the bottom it still says "evaluating on training data..." and no results show in the Attribute selection output window. Here is a 10 second video of this behaviour
https://drive.google.com/open?id=0B9eTJeTneln6N2poQmpfT04zTFE
What is happening and why. I don't believe it is a lack of computing power since there is a 6 vCPUs, 34 GB configuration.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Mark Hall
Which version of Weka are you running? Perhaps Weka is running out of memory. Older versions of Weka had a 1Gb default heap size setting for the JVM. If you launch Weka with the console option (Windows), or from a terminal *nix, then you might see some exceptions/errors printed. You can also check the weka.log file in ~/wekafiles.

Cheers,
Mark.

On 9/01/17, 10:16 PM, "Jenna" <[hidden email] on behalf of [hidden email]> wrote:

    I am running weka Explorer in the cloud (Google Cloud) on Windows with a 34gb
    memory and 6 cpus.
    The dataset is about 125mb, has 1000 features and about 30,000 rows.
    Sometimes, mostly when doing feature selection, the program will run, the
    little Weka bird at bottom right of the screen will stop moving after a
    certain period of time (say 1 minute), the Start button will become
    available, but in the status bar at the bottom it still says "evaluating on
    training data..." and no results show in the Attribute selection output
    window. Here is a 10 second video of this behaviour
    https://drive.google.com/open?id=0B9eTJeTneln6N2poQmpfT04zTFE
    What is happening and why. I don't believe it is a lack of computing power
    since there is a 6 vCPUs, 34 GB configuration.
   
   
   
    --
    View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155.html
    Sent from the WEKA mailing list archive at Nabble.com.
    _______________________________________________
    Wekalist mailing list
    Send posts to: [hidden email]
    List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
    List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
   


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thanks. I am running 3.9.1

Here is part of my RunWeka.ini file.
I see I had a conflict but I don't think it was having an effect with this: -Xmx4g


# setups (prefixed with "cmd_")
cmd_default=javaw -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" #mainclass#
cmd_console=cmd.exe /K start cmd.exe /K "java -Xss#maxstack# -Dfile.encoding=#fileEncoding# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath \"#wekajar#;#cp#\" #mainclass#"
cmd_explorer=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.explorer.Explorer
cmd_knowledgeFlow=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.knowledgeflow.KnowledgeFlow

# placeholders ("#bla#" in command gets replaced with content of key "bla")
# Note: "#wekajar#" gets replaced by the launcher class, since that jar gets
#       provided as parameter
maxstack=20m
-Xmx4g
# The MDI GUI
#mainclass=weka.gui.Main
# The GUIChooser
mainclass=weka.gui.GUIChooser
# The file encoding; use "utf-8" instead of "Cp1252" to display UTF-8 characters in the 
# GUI, e.g., the Explorer
fileEncoding=Cp1252
maxheap=20072M


Here is Weka.logs:

2017-01-09 13:40:48 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:10 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (39321 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:14 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (41687 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:19 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (46419 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:42 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (55883 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:43:08 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 33.0 -S 1
2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P33.0-S1 (62129 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException

On Tue, Jan 10, 2017 at 3:22 AM, Mark Hall [via WEKA] <[hidden email]> wrote:
Which version of Weka are you running? Perhaps Weka is running out of memory. Older versions of Weka had a 1Gb default heap size setting for the JVM. If you launch Weka with the console option (Windows), or from a terminal *nix, then you might see some exceptions/errors printed. You can also check the weka.log file in ~/wekafiles.

Cheers,
Mark.

On 9/01/17, 10:16 PM, "Jenna" <[hidden email] on behalf of [hidden email]> wrote:

    I am running weka Explorer in the cloud (Google Cloud) on Windows with a 34gb
    memory and 6 cpus.
    The dataset is about 125mb, has 1000 features and about 30,000 rows.
    Sometimes, mostly when doing feature selection, the program will run, the
    little Weka bird at bottom right of the screen will stop moving after a
    certain period of time (say 1 minute), the Start button will become
    available, but in the status bar at the bottom it still says "evaluating on
    training data..." and no results show in the Attribute selection output
    window. Here is a 10 second video of this behaviour
    https://drive.google.com/open?id=0B9eTJeTneln6N2poQmpfT04zTFE
    What is happening and why. I don't believe it is a lack of computing power
    since there is a 6 vCPUs, 34 GB configuration.
   
   
   
    --
    View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155.html
    Sent from the WEKA mailing list archive at Nabble.com.
    _______________________________________________
    Wekalist mailing list
    Send posts to: [hidden email]
    List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
    List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
   


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39157.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Mark Hall

Hmm. Is that the full log? I don't see any entries pertaining to attribute selection, just filtering from the PreprocessPanel. I'm not sure what is causing the NPEs in the log, I can't seem to replicate them on my machine when filtering some benchmark datasets. Are you using an Oracle JVM?

 

Note that the maxheap property is no longer used in the RunWeka.ini file. We let the JVM set the heap size according to how much RAM is available on the machine. If you want to force a particular maximum heap size then the JAVA_OPTS environment variable can be used to specify a –Xmx setting.

 

Cheers,

Mark.

 

 

From: <[hidden email]> on behalf of Jenna <[hidden email]>
Reply-To: "Weka machine learning workbench list." <[hidden email]>
Date: Tuesday, 10 January 2017 at 10:35 AM
To: "Weka machine learning workbench list." <[hidden email]>
Subject: Re: [Wekalist] Weka Explorer freeze in Windows 34gb memory

 

Thanks. I am running 3.9.1

 

Here is part of my RunWeka.ini file.

I see I had a conflict but I don't think it was having an effect with this: -Xmx4g

 

 

# setups (prefixed with "cmd_")

cmd_default=javaw -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" #mainclass#

cmd_console=cmd.exe /K start cmd.exe /K "java -Xss#maxstack# -Dfile.encoding=#fileEncoding# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath \"#wekajar#;#cp#\" #mainclass#"

cmd_explorer=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.explorer.Explorer

cmd_knowledgeFlow=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.knowledgeflow.KnowledgeFlow

 

# placeholders ("#bla#" in command gets replaced with content of key "bla")

# Note: "#wekajar#" gets replaced by the launcher class, since that jar gets

#       provided as parameter

maxstack=20m

-Xmx4g

# The MDI GUI

#mainclass=weka.gui.Main

# The GUIChooser

mainclass=weka.gui.GUIChooser

# The file encoding; use "utf-8" instead of "Cp1252" to display UTF-8 characters in the 

# GUI, e.g., the Explorer

fileEncoding=Cp1252

maxheap=20072M

 

 

Here is Weka.logs:

 

2017-01-09 13:40:48 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:10 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (39321 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:14 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (41687 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:19 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (46419 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:42 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (55883 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:43:08 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 33.0 -S 1

2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P33.0-S1 (62129 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thank you Mark. How do I set the JAVA_OPTS environment variable in Windows Server 2012. It is currently not in the set of Environment Variables. Do I just create it as JAVA_OPTS in the user variables (system variables has the New button grayed out). And then set the Variable value to –Xmx20gb ?
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator
Yes, although I think you might need to use _JAVA_OPTIONS rather than JAVA_OPTS:

  http://stackoverflow.com/questions/28327620/difference-between-java-options-java-tool-options-and-java-opts

Note that _JAVA_OPTIONS appears to be undocumented. There is also JAVA_TOOL_OPTIONS but _JAVA_OPTIONS has the advantage that it overrides any command-line settings given when the java command is executed (e.g., a different -Xmx setting provided in WEKA’s default start-up script for Windows).

I normally use _JAVA_OPTIONS. It seems to work fine and provides an easy way to change the default heap size, etc., without having to fiddle with start-up scripts.

Cheers,
Eibe

> On 11/01/2017, at 8:10 PM, Jenna <[hidden email]> wrote:
>
> Thank you Mark. How do I set the JAVA_OPTS environment variable in Windows
> Server 2012. It is currently not in the set of Environment Variables. Do I
> just create it as JAVA_OPTS in the user variables (system variables has the
> New button grayed out). And then set the Variable value to –Xmx20gb ?
>
>
>
> --
> View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39168.html
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
This post has NOT been accepted by the mailing list yet.
Hello again. I am running Weka 3.9 in the cloud with 34gb ram in Windows Server2012. 

The SystemInfo is:

WEKA_HOME C:\Users\william108\wekafiles
awt.toolkit sun.awt.windows.WToolkit
file.encoding Cp1252
file.encoding.pkg sun.io
file.separator \
java.awt.graphicsenv sun.awt.Win32GraphicsEnvironment
java.awt.printerjob sun.awt.windows.WPrinterJob
java.class.path ./weka.jar;
java.class.version 52.0
java.endorsed.dirs C:\Program Files\Java\jre1.8.0_121\lib\endorsed
java.ext.dirs C:\Program Files\Java\jre1.8.0_121\lib\ext;C:\windows\Sun\Java\lib\ext
java.home C:\Program Files\Java\jre1.8.0_121
java.io.tmpdir C:\Users\WILLIA~1\AppData\Local\Temp\2\
java.library.path C:\ProgramData\Oracle\Java\javapath;C:\windows\Sun\Java\bin;C:\windows\system32;C:\windows;C:\ProgramData\Oracle\Java\javapath;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\ProgramData\GooGet;C:\Program Files (x86)\Google\Cloud SDK\google-cloud-sdk\bin;C:\Program Files\Compute Engine\sysprep;C:\Program Files\Google\Compute Engine\sysprep\;C:\Program Files\Google\Compute Engine\metadata_scripts\;C:\Program Files\EmEditor;.;C:\Users\william108\wekafiles\native
java.net.useSystemProxies true
java.runtime.name Java(TM) SE Runtime Environment
java.runtime.version 1.8.0_121-b13
java.specification.name Java Platform API Specification
java.specification.vendor Oracle Corporation
java.specification.version 1.8
java.vendor Oracle Corporation
java.vendor.url http://java.oracle.com/
java.vendor.url.bug http://bugreport.sun.com/bugreport/
java.version 1.8.0_121
java.vm.info mixed mode
java.vm.name Java HotSpot(TM) 64-Bit Server VM
java.vm.specification.name Java Virtual Machine Specification
java.vm.specification.vendor Oracle Corporation
java.vm.specification.version 1.8
java.vm.vendor Oracle Corporation
java.vm.version 25.121-b13
line.separator
memory.initial 544MB (570425344)
memory.max 22222.5MB (23301980160)
os.arch amd64
os.name Windows Server 2012 R2
os.version 6.3
path.separator ;
sun.arch.data.model 64
sun.awt.enableExtraMouseButtons true
sun.boot.class.path C:\Program Files\Java\jre1.8.0_121\lib\resources.jar;C:\Program Files\Java\jre1.8.0_121\lib\rt.jar;C:\Program Files\Java\jre1.8.0_121\lib\sunrsasign.jar;C:\Program Files\Java\jre1.8.0_121\lib\jsse.jar;C:\Program Files\Java\jre1.8.0_121\lib\jce.jar;C:\Program Files\Java\jre1.8.0_121\lib\charsets.jar;C:\Program Files\Java\jre1.8.0_121\lib\jfr.jar;C:\Program Files\Java\jre1.8.0_121\classes
sun.boot.library.path C:\Program Files\Java\jre1.8.0_121\bin
sun.cpu.endian little
sun.cpu.isalist amd64
sun.desktop windows
sun.io.unicode.encoding UnicodeLittle
sun.java.command weka.gui.GUIChooser
sun.java.launcher SUN_STANDARD
sun.jnu.encoding Cp1252
sun.management.compiler HotSpot 64-Bit Tiered Compilers
sun.os.patch.level
sun.stderr.encoding cp437
sun.stdout.encoding cp437
ui.currentLookAndFeel com.sun.java.swing.plaf.windows.WindowsLookAndFeel
ui.installedLookAndFeels javax.swing.plaf.metal.MetalLookAndFeel,javax.swing.plaf.nimbus.NimbusLookAndFeel,com.sun.java.swing.plaf.motif.MotifLookAndFeel,com.sun.java.swing.plaf.windows.WindowsLookAndFeel,com.sun.java.swing.plaf.windows.WindowsClassicLookAndFeel
user.country US
user.dir C:\Program Files\Weka-3-9
user.home C:\Users\william108
user.language en
user.name william108
user.script
user.timezone GMT
user.variant
weka.version 3.9.1


The console information is:

        at weka.python.PythonSession.<init>(PythonSession.java:140)
        at weka.python.PythonSession.initSession(PythonSession.java:593)
        ... 42 more
Caused by: java.io.IOException: CreateProcess error=2, The system cannot find th
e file specified
        at java.lang.ProcessImpl.create(Native Method)
        at java.lang.ProcessImpl.<init>(Unknown Source)
        at java.lang.ProcessImpl.start(Unknown Source)
        ... 45 more
null
java.lang.NullPointerException
        weka.core.Instances.<init>(Instances.java:179)
        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPan
el.java:3252)
        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPa
nel.java:3292)
        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.jav
a:343)
        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
        java.awt.event.InvocationEvent.dispatch(Unknown Source)
        java.awt.EventQueue.dispatchEventImpl(Unknown Source)
        java.awt.EventQueue.access$500(Unknown Source)
        java.awt.EventQueue$3.run(Unknown Source)
        java.awt.EventQueue$3.run(Unknown Source)
        java.security.AccessController.doPrivileged(Native Method)
        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPriv
ilege(Unknown Source)
        java.awt.EventQueue.dispatchEvent(Unknown Source)
        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
        java.awt.EventDispatchThread.pumpEvents(Unknown Source)
        java.awt.EventDispatchThread.pumpEvents(Unknown Source)
        java.awt.EventDispatchThread.run(Unknown Source)

        at weka.core.Instances.<init>(Instances.java:179)
        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(Classifier
Panel.java:3252)
        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(Classifie
rPanel.java:3292)
        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.
java:343)
        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
        at java.awt.event.InvocationEvent.dispatch(Unknown Source)
        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
        at java.awt.EventQueue.access$500(Unknown Source)
        at java.awt.EventQueue$3.run(Unknown Source)
        at java.awt.EventQueue$3.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionP
rivilege(Unknown Source)
        at java.awt.EventQueue.dispatchEvent(Unknown Source)
        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
        at java.awt.EventDispatchThread.run(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
914 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:42:57.890 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
915 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
915 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
916 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
916 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
918 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
918 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
920 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:59.
919 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
225.109375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 150.109375 (s
ecs). Next warning at 151.109375 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
263 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:44:05.252 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
263 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:07.
294 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
234.234375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 159.234375 (s
ecs). Next warning at 160.234375 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:46:26.
180 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 12:46:26.149 [Thre
ad-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Random
Forest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap
 space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:49:24.107 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:51:35.
227 [main] WARN Experiment - [WARN ] Algorithm Run Result reported wallclock tim
e of 128.177 (secs) that exceeded it's cutoff time of 75.0 (secs) by 53.17699999
999999 (secs). Next warning at 54.17699999999999 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:56:51.126 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:52.
737 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
223.859375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 148.859375 (s
ecs). Next warning at 149.859375 (secs)
[Thread-12] INFO weka.classifiers.meta.AutoWEKAClassifier - Estimated mean quali
ty of final incumbent config 1 (internal ID: 0x000D) on test set: 1.0E100, based
 on 1 run(s) on 1 test instance(s).
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:57:55.
731 [main] WARN SubProcessWrapper - 2017-02-18 12:57:55.731 [Thread-0] WARN Clas
sifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10,
 -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-11] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppDat
a\Local\Temp\2\autoweka5391380218609381469\Auto-WEKA
[Thread-11] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best confi
guration estimate 1.0
[Thread-11] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, ar
guments: [], attribute search: null, attribute search arguments: [], attribute e
valuation: null, attribute evaluation arguments: []
Exception in thread "Thread-11" java.lang.OutOfMemoryError: Java heap space
        weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:
842)
        weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
        weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:
713)
        weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
        weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSel
ection.java:625)
        weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassif
ier.java:499)
        weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

        at weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.ja
va:842)
        at weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:74
8)
        at weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.ja
va:713)
        at weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854
)
        at weka.attributeSelection.AttributeSelection.SelectAttributes(Attribute
Selection.java:625)
        at weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClas
sifier.java:499)
        at weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)


I have set the JAVA_OPTS parameter to -Xmx25000m
and am trying AutoWeka.
The configuration is
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 31024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 200

I also tried the default batch-size of 100

The data file size is 294,794 KB with about 400,000 rows and about 40 attributes

I am getting the little bird running and then stopping. In the status bar it says "Auto-Weka has started" even though the little bird has stopped. 
No output is delivered to the Auto-Weka output window.
The log file is below.



2017-02-18 11:30:50 weka.gui.GUIChooserApp main
INFO: Logging started
2017-02-18 11:30:54 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
2017-02-18 11:30:59 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2017-02-18 11:30:59 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2017-02-18 11:30:59 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
INFO: Weka Explorer
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
INFO: (c) 1999-2016 The University of Waikato, Hamilton, New Zealand
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
INFO: Started on Saturday, 18 February 2017
weka.core.WekaException: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
weka.python.PythonSession.initSession(PythonSession.java:595)
weka.gui.PythonPanel.<init>(PythonPanel.java:464)
weka.gui.explorer.PythonExplorerPanel.setup(PythonExplorerPanel.java:62)
weka.gui.explorer.PythonExplorerPanel.setExplorer(PythonExplorerPanel.java:74)
weka.gui.explorer.Explorer.<init>(Explorer.java:236)
weka.gui.GUIChooserApp.showExplorer(GUIChooserApp.java:1303)
weka.gui.GUIChooserApp$22.actionPerformed(GUIChooserApp.java:1127)
javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
javax.swing.DefaultButtonModel.setPressed(Unknown Source)
javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
java.awt.Component.processMouseEvent(Unknown Source)
javax.swing.JComponent.processMouseEvent(Unknown Source)
java.awt.Component.processEvent(Unknown Source)
java.awt.Container.processEvent(Unknown Source)
java.awt.Component.dispatchEventImpl(Unknown Source)
java.awt.Container.dispatchEventImpl(Unknown Source)
java.awt.Component.dispatchEvent(Unknown Source)
java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
java.awt.Container.dispatchEventImpl(Unknown Source)
java.awt.Window.dispatchEventImpl(Unknown Source)
java.awt.Component.dispatchEvent(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue$4.run(Unknown Source)
java.awt.EventQueue$4.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.python.PythonSession.initSession(PythonSession.java:595)
at weka.gui.PythonPanel.<init>(PythonPanel.java:464)
at weka.gui.explorer.PythonExplorerPanel.setup(PythonExplorerPanel.java:62)
at weka.gui.explorer.PythonExplorerPanel.setExplorer(PythonExplorerPanel.java:74)
at weka.gui.explorer.Explorer.<init>(Explorer.java:236)
at weka.gui.GUIChooserApp.showExplorer(GUIChooserApp.java:1303)
at weka.gui.GUIChooserApp$22.actionPerformed(GUIChooserApp.java:1127)
at javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
at javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.setPressed(Unknown Source)
at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
at java.awt.Component.processMouseEvent(Unknown Source)
at javax.swing.JComponent.processMouseEvent(Unknown Source)
at java.awt.Component.processEvent(Unknown Source)
at java.awt.Container.processEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Window.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
Caused by: java.io.IOException: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(Unknown Source)
at weka.python.PythonSession.<init>(PythonSession.java:140)
at weka.python.PythonSession.initSession(PythonSession.java:593)
... 42 more
Caused by: java.io.IOException: CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessImpl.create(Native Method)
at java.lang.ProcessImpl.<init>(Unknown Source)
at java.lang.ProcessImpl.start(Unknown Source)
... 45 more
2017-02-18 11:31:03 weka.gui.PythonPanel logMessage
INFO: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
null
2017-02-18 11:31:03 weka.gui.PythonPanel logMessage
INFO: Python is not available!!
2017-02-18 11:31:03 weka.gui.PythonPanel logMessage
INFO: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
2017-02-18 11:31:04 weka.gui.PythonPanel setLogger
INFO: Python is not available!!
2017-02-18 11:31:04 weka.gui.PythonPanel setLogger
INFO: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
2017-02-18 11:33:23 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R86,82,83,16,75,77,3,40,68,6,33,74,80,17,9,44,56,54,52,58,62,64,46,66,60,48,50,78,4,30,71,5,84,20,81,10,32,87-weka.filters.unsupervised.instance.RemovePercentage-P50.0 (200796 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:33:23 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:38:50 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97 (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:38:50 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:41:26 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.unsupervised.attribute.Remove -R 16,75,80,82-83,85-86
2017-02-18 11:42:02 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86 (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:42:03 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:42:57 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.unsupervised.attribute.StringToNominal -R first-last
2017-02-18 11:43:26 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:43:26 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Started weka.attributeSelection.OneRAttributeEval
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Command: weka.attributeSelection.OneRAttributeEval -s "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -S 1 -F 10 -B 6
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Filter command: weka.filters.supervised.attribute.AttributeSelection -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1"
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Meta-classifier command: weka.classifiers.meta.AttributeSelectedClassifier -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -W weka.classifiers.trees.J48 -- -C 0.25 -M 2
java.lang.Exception: No feature selection has been performed yet!
weka.attributeSelection.AttributeSelection.reduceDimensionality(AttributeSelection.java:265)
weka.gui.explorer.AttributeSelectionPanel$10.run(AttributeSelectionPanel.java:898)

at weka.attributeSelection.AttributeSelection.reduceDimensionality(AttributeSelection.java:265)
at weka.gui.explorer.AttributeSelectionPanel$10.run(AttributeSelectionPanel.java:898)
2017-02-18 11:45:05 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Interrupted weka.attributeSelection.OneRAttributeEval weka.attributeSelection.Ranker
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Started weka.attributeSelection.OneRAttributeEval
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Command: weka.attributeSelection.OneRAttributeEval -s "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -S 1 -F 10 -B 6
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Filter command: weka.filters.supervised.attribute.AttributeSelection -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1"
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Meta-classifier command: weka.classifiers.meta.AttributeSelectedClassifier -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -W weka.classifiers.trees.J48 -- -C 0.25 -M 2
2017-02-18 11:48:45 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Finished weka.attributeSelection.OneRAttributeEval weka.attributeSelection.Ranker
2017-02-18 11:52:36 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.unsupervised.attribute.Remove -V -R 65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80
2017-02-18 11:52:54 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80 (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:52:54 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:55:00 weka.gui.explorer.AutoWEKAPanel$13 run
INFO: Started Auto-WEKA for R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:56:24.661 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 11:56:24.611 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:56:26.218 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of 225.484375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 150.484375 (secs). Next warning at 151.484375 (secs)  
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:57:29.490 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 11:57:29.441 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:59:44.543 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 11:59:44.506 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.361 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:02:47.349 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.361 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:34)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at java.util.ArrayList.<init>(Unknown Source)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.initialize(Instances.java:215)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.<init>(Instances.java:194)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.ParallelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClassifierEnhancer.java:229)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.meta.Bagging.buildClassifier(Bagging.java:734)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.ClassifierRunner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:26)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:49.185 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of 258.78125 (secs) that exceeded it's cutoff time of 75.0 (secs) by 183.78125 (secs). Next warning at 184.78125 (secs)  
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:05:00.171 [main] WARN Experiment - [WARN ] Algorithm Run Result reported wallclock time of 129.539 (secs) that exceeded it's cutoff time of 75.0 (secs) by 54.53899999999999 (secs). Next warning at 55.53899999999999 (secs)  
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:10:10.992 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:10:10.991 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:10:11.042 [main] WARN Experiment - [WARN ] [PROCESS-ERR] java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:10:12.593 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of 191.140625 (secs) that exceeded it's cutoff time of 75.0 (secs) by 116.140625 (secs). Next warning at 117.140625 (secs)  
[Thread-91] INFO weka.classifiers.meta.AutoWEKAClassifier - Estimated mean quality of final incumbent config 1 (internal ID: 0x000D) on test set: 1.0E100, based on 1 run(s) on 1 test instance(s).
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:11:08.982 [main] WARN SubProcessWrapper - 2017-02-18 12:11:08.982 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-90] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppData\Local\Temp\2\autoweka2749930905287815990\Auto-WEKA
[Thread-90] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best configuration estimate 1.0
[Thread-90] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, arguments: [], attribute search: null, attribute search arguments: [], attribute evaluation: null, attribute evaluation arguments: []
Exception in thread "Thread-90" java.lang.OutOfMemoryError: Java heap space
weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:842)
weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:713)
weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSelection.java:625)
weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassifier.java:499)
weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

at weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:842)
at weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
at weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:713)
at weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
at weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSelection.java:625)
at weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassifier.java:499)
at weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)
2017-02-18 12:19:44 weka.gui.explorer.AutoWEKAPanel$13 run
INFO: Started Auto-WEKA for R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.394 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:21:14.308 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.469 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.470 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:34)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.470 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMemoryError: Java heap space
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.471 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at java.util.ArrayList.<init>(Unknown Source)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.471 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.initialize(Instances.java:215)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.<init>(Instances.java:194)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.ParallelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClassifierEnhancer.java:229)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.meta.Bagging.buildClassifier(Bagging.java:734)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.ClassifierRunner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:26)
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - 
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - [error occurred during error reporting (null), id 0xc0000005]
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - 
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - #
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # There is insufficient memory for the Java Runtime Environment to continue.
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # Native memory allocation (malloc) failed to allocate 32744 bytes for ChunkPool::allocate
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # An error report file with more information is saved as:
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # C:\Users\WILLIA~1\AppData\Local\Temp\2\\hs_err_pid6004.log
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - #
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # Compiler replay data is saved as:
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # C:\Users\WILLIA~1\AppData\Local\Temp\2\\replay_pid6004.log
[Thread-93] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppData\Local\Temp\2\autoweka8268648569384342543\Auto-WEKA
[Thread-93] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best configuration estimate -1.0
[Thread-93] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, arguments: [], attribute search: null, attribute search arguments: [], attribute evaluation: null, attribute evaluation arguments: []


On Thu, Jan 12, 2017 at 9:39 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
Yes, although I think you might need to use _JAVA_OPTIONS rather than JAVA_OPTS:

  http://stackoverflow.com/questions/28327620/difference-between-java-options-java-tool-options-and-java-opts

Note that _JAVA_OPTIONS appears to be undocumented. There is also JAVA_TOOL_OPTIONS but _JAVA_OPTIONS has the advantage that it overrides any command-line settings given when the java command is executed (e.g., a different -Xmx setting provided in WEKA’s default start-up script for Windows).

I normally use _JAVA_OPTIONS. It seems to work fine and provides an easy way to change the default heap size, etc., without having to fiddle with start-up scripts.

Cheers,
Eibe

> On 11/01/2017, at 8:10 PM, Jenna <[hidden email]> wrote:
>
> Thank you Mark. How do I set the JAVA_OPTS environment variable in Windows
> Server 2012. It is currently not in the set of Environment Variables. Do I
> just create it as JAVA_OPTS in the user variables (system variables has the
> New button grayed out). And then set the Variable value to –Xmx20gb ?
>
>
>
> --
> View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39168.html
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39180.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
In reply to this post by Eibe Frank-2

On Sat, Feb 18, 2017 at 10:06 PM, Bill <[hidden email]> wrote:
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 31024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 200

​I also tried this configuration:
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 23024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 100

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator

> On 19 Feb 2017, at 02:08, Jenna <[hidden email]> wrote:
>
>
> On Sat, Feb 18, 2017 at 10:06 PM, Bill <[hidden email]> wrote:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 31024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 200
>
> ​I also tried this configuration:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 23024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 100​
>

From your other message in the Nabble thread (that message didn't actually get sent to the list for some reason) it looks like -memLimit 31024 gives you

...
...# There is insufficient memory for the Java Runtime Environment to continue.
...

This means there isn't actually enough physical RAM available to run the Java program, perhaps because you are also running some other stuff on this machine.

From some of your other messages in this thread, it looks like some of the tree learners invoked by AutoWEKA are running out of heap space on your data. Is it possible that your data has nominal attributes with lots of values? Those can cause memory problems because most of the tree learners in WEKA create multi-way splits, with one branch per value, when a nominal attribute is used for splitting. Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

Cheers,
Eibe
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages. I am not running any other software but Weka actually. I think there may be some nominals with many values. 

Hello again. I am running Weka 3.9 in the cloud with 34gb ram in Windows Server2012. 

The SystemInfo is:

WEKA_HOMEC:\Users\william108\wekafiles
awt.toolkitsun.awt.windows.WToolkit
file.encodingCp1252
file.encoding.pkgsun.io
file.separator\
java.awt.graphicsenvsun.awt.Win32GraphicsEnvironment
java.awt.printerjobsun.awt.windows.WPrinterJob
java.class.path./weka.jar;
java.class.version52.0
java.endorsed.dirsC:\Program Files\Java\jre1.8.0_121\lib\endorsed
java.ext.dirsC:\Program Files\Java\jre1.8.0_121\lib\ext;C:\windows\Sun\Java\lib\ext
java.homeC:\Program Files\Java\jre1.8.0_121
java.io.tmpdirC:\Users\WILLIA~1\AppData\Local\Temp\2\
java.library.pathC:\ProgramData\Oracle\Java\javapath;C:\windows\Sun\Java\bin;C:\windows\system32;C:\windows;C:\ProgramData\Oracle\Java\javapath;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\ProgramData\GooGet;C:\Program Files (x86)\Google\Cloud SDK\google-cloud-sdk\bin;C:\Program Files\Compute Engine\sysprep;C:\Program Files\Google\Compute Engine\sysprep\;C:\Program Files\Google\Compute Engine\metadata_scripts\;C:\Program Files\EmEditor;.;C:\Users\william108\wekafiles\native
java.net.useSystemProxiestrue
java.runtime.nameJava(TM) SE Runtime Environment
java.runtime.version1.8.0_121-b13
java.specification.nameJava Platform API Specification
java.specification.vendorOracle Corporation
java.specification.version1.8
java.vendorOracle Corporation
java.vendor.urlhttp://java.oracle.com/
java.vendor.url.bughttp://bugreport.sun.com/bugreport/
java.version1.8.0_121
java.vm.infomixed mode
java.vm.nameJava HotSpot(TM) 64-Bit Server VM
java.vm.specification.nameJava Virtual Machine Specification
java.vm.specification.vendorOracle Corporation
java.vm.specification.version1.8
java.vm.vendorOracle Corporation
java.vm.version25.121-b13
line.separator
memory.initial544MB (570425344)
memory.max22222.5MB (23301980160)
os.archamd64
os.nameWindows Server 2012 R2
os.version6.3
path.separator;
sun.arch.data.model64
sun.awt.enableExtraMouseButtonstrue
sun.boot.class.pathC:\Program Files\Java\jre1.8.0_121\lib\resources.jar;C:\Program Files\Java\jre1.8.0_121\lib\rt.jar;C:\Program Files\Java\jre1.8.0_121\lib\sunrsasign.jar;C:\Program Files\Java\jre1.8.0_121\lib\jsse.jar;C:\Program Files\Java\jre1.8.0_121\lib\jce.jar;C:\Program Files\Java\jre1.8.0_121\lib\charsets.jar;C:\Program Files\Java\jre1.8.0_121\lib\jfr.jar;C:\Program Files\Java\jre1.8.0_121\classes
sun.boot.library.pathC:\Program Files\Java\jre1.8.0_121\bin
sun.cpu.endianlittle
sun.cpu.isalistamd64
sun.desktopwindows
sun.io.unicode.encodingUnicodeLittle
sun.java.commandweka.gui.GUIChooser
sun.java.launcherSUN_STANDARD
sun.jnu.encodingCp1252
sun.management.compilerHotSpot 64-Bit Tiered Compilers
sun.os.patch.level
sun.stderr.encodingcp437
sun.stdout.encodingcp437
ui.currentLookAndFeelcom.sun.java.swing.plaf.windows.WindowsLookAndFeel
ui.installedLookAndFeelsjavax.swing.plaf.metal.MetalLookAndFeel,javax.swing.plaf.nimbus.NimbusLookAndFeel,com.sun.java.swing.plaf.motif.MotifLookAndFeel,com.sun.java.swing.plaf.windows.WindowsLookAndFeel,com.sun.java.swing.plaf.windows.WindowsClassicLookAndFeel
user.countryUS
user.dirC:\Program Files\Weka-3-9
user.homeC:\Users\william108
user.languageen
user.namewilliam108
user.script
user.timezoneGMT
user.variant
weka.version3.9.1


The console information is:

        at weka.python.PythonSession.<init>(PythonSession.java:140)
        at weka.python.PythonSession.initSession(PythonSession.java:593)
        ... 42 more
Caused by: java.io.IOException: CreateProcess error=2, The system cannot find th
e file specified
        at java.lang.ProcessImpl.create(Native Method)
        at java.lang.ProcessImpl.<init>(Unknown Source)
        at java.lang.ProcessImpl.start(Unknown Source)
        ... 45 more
null
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
914 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:42:57.890 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
915 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
915 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
916 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
916 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
918 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
918 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
920 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:59.
919 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
225.109375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 150.109375 (s
ecs). Next warning at 151.109375 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
263 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:44:05.252 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
263 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:07.
294 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
234.234375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 159.234375 (s
ecs). Next warning at 160.234375 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:46:26.
180 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 12:46:26.149 [Thre
ad-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Random
Forest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap
 space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:49:24.107 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:51:35.
227 [main] WARN Experiment - [WARN ] Algorithm Run Result reported wallclock tim
e of 128.177 (secs) that exceeded it's cutoff time of 75.0 (secs) by 53.17699999
999999 (secs). Next warning at 54.17699999999999 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:56:51.126 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:52.
737 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
223.859375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 148.859375 (s
ecs). Next warning at 149.859375 (secs)
[Thread-12] INFO weka.classifiers.meta.AutoWEKAClassifier - Estimated mean quali
ty of final incumbent config 1 (internal ID: 0x000D) on test set: 1.0E100, based
 on 1 run(s) on 1 test instance(s).
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:57:55.
731 [main] WARN SubProcessWrapper - 2017-02-18 12:57:55.731 [Thread-0] WARN Clas
sifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10,
 -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-11] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppDat
a\Local\Temp\2\autoweka5391380218609381469\Auto-WEKA
[Thread-11] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best confi
guration estimate 1.0
[Thread-11] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, ar
guments: [], attribute search: null, attribute search arguments: [], attribute e
valuation: null, attribute evaluation arguments: []
Exception in thread "Thread-11" java.lang.OutOfMemoryError: Java heap space
        weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:
842)
        weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
        weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:
713)
        weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
        weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSel
ection.java:625)
        weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassif
ier.java:499)
        weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

        at weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.ja
va:842)
        at weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:74
8)
        at weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.ja
va:713)
        at weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854
)
        at weka.attributeSelection.AttributeSelection.SelectAttributes(Attribute
Selection.java:625)
        at weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClas
sifier.java:499)
        at weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

On Sun, Feb 19, 2017 at 11:41 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

> On 19 Feb 2017, at 02:08, Jenna <[hidden email]> wrote:
>
>
> On Sat, Feb 18, 2017 at 10:06 PM, Bill <[hidden email]> wrote:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 31024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 200
>
> ​I also tried this configuration:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 23024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 100​
>

From your other message in the Nabble thread (that message didn't actually get sent to the list for some reason) it looks like -memLimit 31024 gives you

...
...# There is insufficient memory for the Java Runtime Environment to continue.
...

This means there isn't actually enough physical RAM available to run the Java program, perhaps because you are also running some other stuff on this machine.

From some of your other messages in this thread, it looks like some of the tree learners invoked by AutoWEKA are running out of heap space on your data. Is it possible that your data has nominal attributes with lots of values? Those can cause memory problems because most of the tree learners in WEKA create multi-way splits, with one branch per value, when a nominal attribute is used for splitting. Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

Cheers,
Eibe
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39455.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
In reply to this post by Eibe Frank-2
I just sent a bunch of info in the previous message but did not send all because I suspect that nabble may cut it off so I am sending the rest here:


I have set the JAVA_OPTS parameter to -Xmx25000m
and am trying AutoWeka.
The configuration is
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 31024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 200

I also tried the default batch-size of 100

The data file size is 294,794 KB with about 400,000 rows and about 40 attributes

I am getting the little bird running and then stopping. In the status bar it says "Auto-Weka has started" even though the little bird has stopped. 
No output is delivered to the Auto-Weka output window.
The log file is below.



2017-02-18 11:30:50 weka.gui.GUIChooserApp main
INFO: Logging started
2017-02-18 11:30:54 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
2017-02-18 11:30:59 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2017-02-18 11:30:59 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2017-02-18 11:30:59 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
INFO: Weka Explorer
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
INFO: (c) 1999-2016 The University of Waikato, Hamilton, New Zealand
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
2017-02-18 11:31:03 weka.gui.explorer.Explorer <init>
INFO: Started on Saturday, 18 February 2017
weka.core.WekaException: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
weka.python.PythonSession.initSession(PythonSession.java:595)
weka.gui.PythonPanel.<init>(PythonPanel.java:464)
weka.gui.explorer.PythonExplorerPanel.setup(PythonExplorerPanel.java:62)
weka.gui.explorer.PythonExplorerPanel.setExplorer(PythonExplorerPanel.java:74)
weka.gui.explorer.Explorer.<init>(Explorer.java:236)
weka.gui.GUIChooserApp.showExplorer(GUIChooserApp.java:1303)
weka.gui.GUIChooserApp$22.actionPerformed(GUIChooserApp.java:1127)
javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
javax.swing.DefaultButtonModel.setPressed(Unknown Source)
javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
java.awt.Component.processMouseEvent(Unknown Source)
javax.swing.JComponent.processMouseEvent(Unknown Source)
java.awt.Component.processEvent(Unknown Source)
java.awt.Container.processEvent(Unknown Source)
java.awt.Component.dispatchEventImpl(Unknown Source)
java.awt.Container.dispatchEventImpl(Unknown Source)
java.awt.Component.dispatchEvent(Unknown Source)
java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
java.awt.Container.dispatchEventImpl(Unknown Source)
java.awt.Window.dispatchEventImpl(Unknown Source)
java.awt.Component.dispatchEvent(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue$4.run(Unknown Source)
java.awt.EventQueue$4.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.python.PythonSession.initSession(PythonSession.java:595)
at weka.gui.PythonPanel.<init>(PythonPanel.java:464)
at weka.gui.explorer.PythonExplorerPanel.setup(PythonExplorerPanel.java:62)
at weka.gui.explorer.PythonExplorerPanel.setExplorer(PythonExplorerPanel.java:74)
at weka.gui.explorer.Explorer.<init>(Explorer.java:236)
at weka.gui.GUIChooserApp.showExplorer(GUIChooserApp.java:1303)
at weka.gui.GUIChooserApp$22.actionPerformed(GUIChooserApp.java:1127)
at javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
at javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.setPressed(Unknown Source)
at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
at java.awt.Component.processMouseEvent(Unknown Source)
at javax.swing.JComponent.processMouseEvent(Unknown Source)
at java.awt.Component.processEvent(Unknown Source)
at java.awt.Container.processEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Window.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
Caused by: java.io.IOException: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(Unknown Source)
at weka.python.PythonSession.<init>(PythonSession.java:140)
at weka.python.PythonSession.initSession(PythonSession.java:593)
... 42 more
Caused by: java.io.IOException: CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessImpl.create(Native Method)
at java.lang.ProcessImpl.<init>(Unknown Source)
at java.lang.ProcessImpl.start(Unknown Source)
... 45 more
2017-02-18 11:31:03 weka.gui.PythonPanel logMessage
INFO: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
null
2017-02-18 11:31:03 weka.gui.PythonPanel logMessage
INFO: Python is not available!!
2017-02-18 11:31:03 weka.gui.PythonPanel logMessage
INFO: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
2017-02-18 11:31:04 weka.gui.PythonPanel setLogger
INFO: Python is not available!!
2017-02-18 11:31:04 weka.gui.PythonPanel setLogger
INFO: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified
2017-02-18 11:33:23 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R86,82,83,16,75,77,3,40,68,6,33,74,80,17,9,44,56,54,52,58,62,64,46,66,60,48,50,78,4,30,71,5,84,20,81,10,32,87-weka.filters.unsupervised.instance.RemovePercentage-P50.0 (200796 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:33:23 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:38:50 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97 (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:38:50 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:41:26 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.unsupervised.attribute.Remove -R 16,75,80,82-83,85-86
2017-02-18 11:42:02 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86 (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:42:03 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:42:57 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.unsupervised.attribute.StringToNominal -R first-last
2017-02-18 11:43:26 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:43:26 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Started weka.attributeSelection.OneRAttributeEval
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Command: weka.attributeSelection.OneRAttributeEval -s "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -S 1 -F 10 -B 6
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Filter command: weka.filters.supervised.attribute.AttributeSelection -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1"
2017-02-18 11:45:04 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Meta-classifier command: weka.classifiers.meta.AttributeSelectedClassifier -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -W weka.classifiers.trees.J48 -- -C 0.25 -M 2
java.lang.Exception: No feature selection has been performed yet!
weka.attributeSelection.AttributeSelection.reduceDimensionality(AttributeSelection.java:265)
weka.gui.explorer.AttributeSelectionPanel$10.run(AttributeSelectionPanel.java:898)

at weka.attributeSelection.AttributeSelection.reduceDimensionality(AttributeSelection.java:265)
at weka.gui.explorer.AttributeSelectionPanel$10.run(AttributeSelectionPanel.java:898)
2017-02-18 11:45:05 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Interrupted weka.attributeSelection.OneRAttributeEval weka.attributeSelection.Ranker
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Started weka.attributeSelection.OneRAttributeEval
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Command: weka.attributeSelection.OneRAttributeEval -s "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -S 1 -F 10 -B 6
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Filter command: weka.filters.supervised.attribute.AttributeSelection -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1"
2017-02-18 11:45:10 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Meta-classifier command: weka.classifiers.meta.AttributeSelectedClassifier -E "weka.attributeSelection.OneRAttributeEval -S 1 -F 10 -B 6" -S "weka.attributeSelection.Ranker -T -1.7976931348623157E308 -N -1" -W weka.classifiers.trees.J48 -- -C 0.25 -M 2
2017-02-18 11:48:45 weka.gui.explorer.AttributeSelectionPanel$10 run
INFO: Finished weka.attributeSelection.OneRAttributeEval weka.attributeSelection.Ranker
2017-02-18 11:52:36 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.unsupervised.attribute.Remove -V -R 65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80
2017-02-18 11:52:54 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80 (401592 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-02-18 11:52:54 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-02-18 11:55:00 weka.gui.explorer.AutoWEKAPanel$13 run
INFO: Started Auto-WEKA for R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:56:24.661 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 11:56:24.611 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:56:26.218 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of 225.484375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 150.484375 (secs). Next warning at 151.484375 (secs)  
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:57:29.490 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 11:57:29.441 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 11:59:44.543 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 11:59:44.506 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.361 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:02:47.349 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.361 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:34)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at java.util.ArrayList.<init>(Unknown Source)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.initialize(Instances.java:215)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.<init>(Instances.java:194)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.362 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.ParallelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClassifierEnhancer.java:229)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.meta.Bagging.buildClassifier(Bagging.java:734)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.ClassifierRunner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:47.363 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:26)
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:02:49.185 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of 258.78125 (secs) that exceeded it's cutoff time of 75.0 (secs) by 183.78125 (secs). Next warning at 184.78125 (secs)  
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:05:00.171 [main] WARN Experiment - [WARN ] Algorithm Run Result reported wallclock time of 129.539 (secs) that exceeded it's cutoff time of 75.0 (secs) by 54.53899999999999 (secs). Next warning at 55.53899999999999 (secs)  
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:10:10.992 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:10:10.991 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:10:11.042 [main] WARN Experiment - [WARN ] [PROCESS-ERR] java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:10:12.593 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of 191.140625 (secs) that exceeded it's cutoff time of 75.0 (secs) by 116.140625 (secs). Next warning at 117.140625 (secs)  
[Thread-91] INFO weka.classifiers.meta.AutoWEKAClassifier - Estimated mean quality of final incumbent config 1 (internal ID: 0x000D) on test set: 1.0E100, based on 1 run(s) on 1 test instance(s).
[Thread-91] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:11:08.982 [main] WARN SubProcessWrapper - 2017-02-18 12:11:08.982 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-90] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppData\Local\Temp\2\autoweka2749930905287815990\Auto-WEKA
[Thread-90] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best configuration estimate 1.0
[Thread-90] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, arguments: [], attribute search: null, attribute search arguments: [], attribute evaluation: null, attribute evaluation arguments: []
Exception in thread "Thread-90" java.lang.OutOfMemoryError: Java heap space
weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:842)
weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:713)
weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSelection.java:625)
weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassifier.java:499)
weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

at weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:842)
at weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
at weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:713)
at weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
at weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSelection.java:625)
at weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassifier.java:499)
at weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)
2017-02-18 12:19:44 weka.gui.explorer.AutoWEKAPanel$13 run
INFO: Started Auto-WEKA for R_data_frame-weka.filters.unsupervised.attribute.Remove-R181-184-weka.filters.unsupervised.attribute.Remove-R175-179-weka.filters.unsupervised.attribute.Remove-R12-15-weka.filters.unsupervised.attribute.Remove-R49-50,149,169-weka.filters.unsupervised.attribute.Remove-R49-51,147-148,166-weka.filters.unsupervised.attribute.Remove-R154-weka.filters.unsupervised.attribute.Remove-R1-2,47,77-79-weka.filters.unsupervised.attribute.RemoveUseless-M99.0-weka.filters.unsupervised.attribute.Remove-R10,19,38,44,72,74,84,88,93,96-97-weka.filters.unsupervised.attribute.Remove-R16,75,80,82-83,85-86-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-V-R65,47,61,45,59,63,49,53,57,55,43,51,79,78,21,12,19,10,40,42,34,17,13,15,25,22,24,14,8,1,30,71,18,48,66,74,16,7,54,56,20,64,80
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.394 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:21:14.308 [Thread-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.469 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.470 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:34)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.470 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMemoryError: Java heap space
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.471 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at java.util.ArrayList.<init>(Unknown Source)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.471 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.initialize(Instances.java:215)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.core.Instances.<init>(Instances.java:194)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.472 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.trees.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.ParallelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClassifierEnhancer.java:229)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at weka.classifiers.meta.Bagging.buildClassifier(Bagging.java:734)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.ClassifierRunner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-94] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:21:14.473 [main] WARN Experiment - [WARN ] [PROCESS-ERR]   at autoweka.WorkerThread.run(WorkerThread.java:26)
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - 
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - [error occurred during error reporting (null), id 0xc0000005]
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - 
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - #
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # There is insufficient memory for the Java Runtime Environment to continue.
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # Native memory allocation (malloc) failed to allocate 32744 bytes for ChunkPool::allocate
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # An error report file with more information is saved as:
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # C:\Users\WILLIA~1\AppData\Local\Temp\2\\hs_err_pid6004.log
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - #
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # Compiler replay data is saved as:
[Thread-94] INFO weka.classifiers.meta.AutoWEKAClassifier - # C:\Users\WILLIA~1\AppData\Local\Temp\2\\replay_pid6004.log
[Thread-93] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppData\Local\Temp\2\autoweka8268648569384342543\Auto-WEKA
[Thread-93] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best configuration estimate -1.0
[Thread-93] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, arguments: [], attribute search: null, attribute search arguments: [], attribute evaluation: null, attribute evaluation arguments: []



On Sun, Feb 19, 2017 at 12:01 PM, Bill <[hidden email]> wrote:
Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages. I am not running any other software but Weka actually. I think there may be some nominals with many values. 

Hello again. I am running Weka 3.9 in the cloud with 34gb ram in Windows Server2012. 

The SystemInfo is:

WEKA_HOMEC:\Users\william108\wekafiles
awt.toolkitsun.awt.windows.WToolkit
file.encodingCp1252
file.encoding.pkgsun.io
file.separator\
java.awt.graphicsenvsun.awt.Win32GraphicsEnvironment
java.awt.printerjobsun.awt.windows.WPrinterJob
java.class.path./weka.jar;
java.class.version52.0
java.endorsed.dirsC:\Program Files\Java\jre1.8.0_121\lib\endorsed
java.ext.dirsC:\Program Files\Java\jre1.8.0_121\lib\ext;C:\windows\Sun\Java\lib\ext
java.homeC:\Program Files\Java\jre1.8.0_121
java.io.tmpdirC:\Users\WILLIA~1\AppData\Local\Temp\2\
java.library.pathC:\ProgramData\Oracle\Java\javapath;C:\windows\Sun\Java\bin;C:\windows\system32;C:\windows;C:\ProgramData\Oracle\Java\javapath;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\ProgramData\GooGet;C:\Program Files (x86)\Google\Cloud SDK\google-cloud-sdk\bin;C:\Program Files\Compute Engine\sysprep;C:\Program Files\Google\Compute Engine\sysprep\;C:\Program Files\Google\Compute Engine\metadata_scripts\;C:\Program Files\EmEditor;.;C:\Users\william108\wekafiles\native
java.net.useSystemProxiestrue
java.runtime.nameJava(TM) SE Runtime Environment
java.runtime.version1.8.0_121-b13
java.specification.nameJava Platform API Specification
java.specification.vendorOracle Corporation
java.specification.version1.8
java.vendorOracle Corporation
java.vendor.urlhttp://java.oracle.com/
java.vendor.url.bughttp://bugreport.sun.com/bugreport/
java.version1.8.0_121
java.vm.infomixed mode
java.vm.nameJava HotSpot(TM) 64-Bit Server VM
java.vm.specification.nameJava Virtual Machine Specification
java.vm.specification.vendorOracle Corporation
java.vm.specification.version1.8
java.vm.vendorOracle Corporation
java.vm.version25.121-b13
line.separator
memory.initial544MB (570425344)
memory.max22222.5MB (23301980160)
os.archamd64
os.nameWindows Server 2012 R2
os.version6.3
path.separator;
sun.arch.data.model64
sun.awt.enableExtraMouseButtonstrue
sun.boot.class.pathC:\Program Files\Java\jre1.8.0_121\lib\resources.jar;C:\Program Files\Java\jre1.8.0_121\lib\rt.jar;C:\Program Files\Java\jre1.8.0_121\lib\sunrsasign.jar;C:\Program Files\Java\jre1.8.0_121\lib\jsse.jar;C:\Program Files\Java\jre1.8.0_121\lib\jce.jar;C:\Program Files\Java\jre1.8.0_121\lib\charsets.jar;C:\Program Files\Java\jre1.8.0_121\lib\jfr.jar;C:\Program Files\Java\jre1.8.0_121\classes
sun.boot.library.pathC:\Program Files\Java\jre1.8.0_121\bin
sun.cpu.endianlittle
sun.cpu.isalistamd64
sun.desktopwindows
sun.io.unicode.encodingUnicodeLittle
sun.java.commandweka.gui.GUIChooser
sun.java.launcherSUN_STANDARD
sun.jnu.encodingCp1252
sun.management.compilerHotSpot 64-Bit Tiered Compilers
sun.os.patch.level
sun.stderr.encodingcp437
sun.stdout.encodingcp437
ui.currentLookAndFeelcom.sun.java.swing.plaf.windows.WindowsLookAndFeel
ui.installedLookAndFeelsjavax.swing.plaf.metal.MetalLookAndFeel,javax.swing.plaf.nimbus.NimbusLookAndFeel,com.sun.java.swing.plaf.motif.MotifLookAndFeel,com.sun.java.swing.plaf.windows.WindowsLookAndFeel,com.sun.java.swing.plaf.windows.WindowsClassicLookAndFeel
user.countryUS
user.dirC:\Program Files\Weka-3-9
user.homeC:\Users\william108
user.languageen
user.namewilliam108
user.script
user.timezoneGMT
user.variant
weka.version3.9.1


The console information is:

        at weka.python.PythonSession.<init>(PythonSession.java:140)
        at weka.python.PythonSession.initSession(PythonSession.java:593)
        ... 42 more
Caused by: java.io.IOException: CreateProcess error=2, The system cannot find th
e file specified
        at java.lang.ProcessImpl.create(Native Method)
        at java.lang.ProcessImpl.<init>(Unknown Source)
        at java.lang.ProcessImpl.start(Unknown Source)
        ... 45 more
null
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
914 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:42:57.890 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
915 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
915 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
916 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
916 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
917 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
918 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
918 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
919 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:57.
920 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:42:59.
919 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
225.109375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 150.109375 (s
ecs). Next warning at 151.109375 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
263 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:44:05.252 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
263 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
264 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:05.
265 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:44:07.
294 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
234.234375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 159.234375 (s
ecs). Next warning at 160.234375 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:46:26.
180 [main] WARN Experiment - [WARN ] [PROCESS-ERR] 2017-02-18 12:46:26.149 [Thre
ad-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Random
Forest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap
 space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:49:24.107 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
124 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
125 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:49:24.
126 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:51:35.
227 [main] WARN Experiment - [WARN ] Algorithm Run Result reported wallclock tim
e of 128.177 (secs) that exceeded it's cutoff time of 75.0 (secs) by 53.17699999
999999 (secs). Next warning at 54.17699999999999 (secs)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  2017-02-18 12:56:51.126 [Thr
ead-0] WARN ClassifierRunner - Training classifier (weka.classifiers.trees.Rando
mForest [-I, 10, -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java hea
p space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  java.lang.RuntimeException:
java.lang.OutOfMemoryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:34)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]  Caused by: java.lang.OutOfMe
moryError: Java heap space
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at java.util.ArrayList.<
init>(Unknown Source)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.i
nitialize(Instances.java:215)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.core.Instances.<
init>(Instances.java:194)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
134 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.splitData(RandomTree.java:1478)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree$Tree.buildTree(RandomTree.java:1412)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.tree
s.RandomTree.buildClassifier(RandomTree.java:706)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.Para
llelIteratedSingleClassifierEnhancer.buildClassifiers(ParallelIteratedSingleClas
sifierEnhancer.java:229)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at weka.classifiers.meta
.Bagging.buildClassifier(Bagging.java:734)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.ClassifierRu
nner$BuilderThread.doWork(ClassifierRunner.java:459)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:51.
135 [main] WARN Experiment - [WARN ] [PROCESS-ERR]      at autoweka.WorkerThread
.run(WorkerThread.java:26)
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:56:52.
737 [main] WARN Experiment - [WARN ] Algorithm Run Result reported a runtime of
223.859375 (secs) that exceeded it's cutoff time of 75.0 (secs) by 148.859375 (s
ecs). Next warning at 149.859375 (secs)
[Thread-12] INFO weka.classifiers.meta.AutoWEKAClassifier - Estimated mean quali
ty of final incumbent config 1 (internal ID: 0x000D) on test set: 1.0E100, based
 on 1 run(s) on 1 test instance(s).
[Thread-12] WARN weka.classifiers.meta.AutoWEKAClassifier - 2017-02-18 12:57:55.
731 [main] WARN SubProcessWrapper - 2017-02-18 12:57:55.731 [Thread-0] WARN Clas
sifierRunner - Training classifier (weka.classifiers.trees.RandomForest [-I, 10,
 -K, 0, -depth, 0]) failed: java.lang.OutOfMemoryError: Java heap space
[Thread-11] INFO autoweka.TrajectoryMerger - Experiment C:\Users\WILLIA~1\AppDat
a\Local\Temp\2\autoweka5391380218609381469\Auto-WEKA
[Thread-11] INFO weka.classifiers.meta.AutoWEKAClassifier - Thread 0, best confi
guration estimate 1.0
[Thread-11] INFO weka.classifiers.meta.AutoWEKAClassifier - classifier: null, ar
guments: [], attribute search: null, attribute search arguments: [], attribute e
valuation: null, attribute evaluation arguments: []
Exception in thread "Thread-11" java.lang.OutOfMemoryError: Java heap space
        weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.java:
842)
        weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:748)
        weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.java:
713)
        weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854)
        weka.attributeSelection.AttributeSelection.SelectAttributes(AttributeSel
ection.java:625)
        weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClassif
ier.java:499)
        weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

        at weka.attributeSelection.CfsSubsetEval.symmUncertCorr(CfsSubsetEval.ja
va:842)
        at weka.attributeSelection.CfsSubsetEval.correlate(CfsSubsetEval.java:74
8)
        at weka.attributeSelection.CfsSubsetEval.evaluateSubset(CfsSubsetEval.ja
va:713)
        at weka.attributeSelection.GreedyStepwise.search(GreedyStepwise.java:854
)
        at weka.attributeSelection.AttributeSelection.SelectAttributes(Attribute
Selection.java:625)
        at weka.classifiers.meta.AutoWEKAClassifier.buildClassifier(AutoWEKAClas
sifier.java:499)
        at weka.gui.explorer.AutoWEKAPanel$13.run(AutoWEKAPanel.java:445)

On Sun, Feb 19, 2017 at 11:41 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

> On 19 Feb 2017, at 02:08, Jenna <[hidden email]> wrote:
>
>
> On Sat, Feb 18, 2017 at 10:06 PM, Bill <[hidden email]> wrote:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 31024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 200
>
> ​I also tried this configuration:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 23024 -nBestConfigs 1 -metric errorRate -parallelRuns 1 -batch-size 100​
>

From your other message in the Nabble thread (that message didn't actually get sent to the list for some reason) it looks like -memLimit 31024 gives you

...
...# There is insufficient memory for the Java Runtime Environment to continue.
...

This means there isn't actually enough physical RAM available to run the Java program, perhaps because you are also running some other stuff on this machine.

From some of your other messages in this thread, it looks like some of the tree learners invoked by AutoWEKA are running out of heap space on your data. Is it possible that your data has nominal attributes with lots of values? Those can cause memory problems because most of the tree learners in WEKA create multi-way splits, with one branch per value, when a nominal attribute is used for splitting. Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

Cheers,
Eibe
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39455.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML


Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator
In reply to this post by Jenna

> On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
>
> Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.

Probably not necessary.

> I am not running any other software but Weka actually.

AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.

> I think there may be some nominals with many values.

OK, that might be the reason why the tree learners are running out of heap space then.

Cheers,
Eibe

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?


On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

> On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
>
> Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.

Probably not necessary.

> I am not running any other software but Weka actually.

AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.

> I think there may be some nominals with many values.

OK, that might be the reason why the tree learners are running out of heap space then.

Cheers,
Eibe

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator
Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

MergeManyValues can be used if you know exactly which values you want to merge.

Cheers,
Eibe

> On 20/02/2017, at 12:43 AM, Jenna <[hidden email]> wrote:
>
> Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?
>
>
> On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
>
> > On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
> >
> > Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.
>
> Probably not necessary.
>
> > I am not running any other software but Weka actually.
>
> AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.
>
> > I think there may be some nominals with many values.
>
> OK, that might be the reason why the tree learners are running out of heap space then.
>
> Cheers,
> Eibe
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
> NAML
>
>
> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?

On Mon, Feb 20, 2017 at 7:25 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

MergeManyValues can be used if you know exactly which values you want to merge.

Cheers,
Eibe

> On 20/02/2017, at 12:43 AM, Jenna <[hidden email]> wrote:
>
> Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?
>
>
> On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

>
> > On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
> >
> > Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.
>
> Probably not necessary.
>
> > I am not running any other software but Weka actually.
>
> AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.
>
> > I think there may be some nominals with many values.
>
> OK, that might be the reason why the tree learners are running out of heap space then.
>
> Cheers,
> Eibe
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
> NAML
>
>
> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39463.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?
Also, as AutoWeka starts up a new instance of Weka and I have about 34 gb of ram, how much should I assign to AutoWeka versus how much in java_opt?
Is this acceptable?
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 29024 -nBestConfigs 1 -metric errorRate -parallelRuns 1

On Mon, Feb 20, 2017 at 4:17 PM, Jenna <[hidden email]> wrote:
Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?

On Mon, Feb 20, 2017 at 7:25 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

MergeManyValues can be used if you know exactly which values you want to merge.

Cheers,
Eibe

> On 20/02/2017, at 12:43 AM, Jenna <[hidden email]> wrote:
>
> Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?
>
>
> On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

>
> > On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
> >
> > Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.
>
> Probably not necessary.
>
> > I am not running any other software but Weka actually.
>
> AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.
>
> > I think there may be some nominals with many values.
>
> OK, that might be the reason why the tree learners are running out of heap space then.
>
> Cheers,
> Eibe
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
> NAML
>
>
> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39463.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML



View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
Sent from the WEKA mailing list archive at Nabble.com.

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator
I don't think so, but my understanding is that it should just move on to the next classifier configuration if a run with a particular configuration is not successful.

You may just have to experiment with the heap sizes. Perhaps half per JVM would be best. However, I don't know much about the inner workings of AutoWEKA.

Cheers,
Eibe

On 20/02/2017, at 8:36 PM, Bill <[hidden email]> wrote:

Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?
Also, as AutoWeka starts up a new instance of Weka and I have about 34 gb of ram, how much should I assign to AutoWeka versus how much in java_opt?
Is this acceptable?
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 29024 -nBestConfigs 1 -metric errorRate -parallelRuns 1

On Mon, Feb 20, 2017 at 4:17 PM, Jenna <[hidden email]> wrote:
Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?

On Mon, Feb 20, 2017 at 7:25 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

MergeManyValues can be used if you know exactly which values you want to merge.

Cheers,
Eibe

> On 20/02/2017, at 12:43 AM, Jenna <[hidden email]> wrote:
>
> Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?
>
>
> On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

>
> > On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
> >
> > Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.
>
> Probably not necessary.
>
> > I am not running any other software but Weka actually.
>
> AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.
>
> > I think there may be some nominals with many values.
>
> OK, that might be the reason why the tree learners are running out of heap space then.
>
> Cheers,
> Eibe
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
> NAML
>
>
> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39463.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML




_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thanks. I am running autoweka now. I used 
MergeInfrequentNominalValues
to the extent that all the attributes, when viewed in the preprocess window, show graphs rather than saying something like "too many values to show".
The configuration is:
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 29024 -nBestConfigs 1 -metric errorRate -parallelRuns 1


Although it is set for 15 minutes, it has been running for 30 minutes. The little bird is continuing to move and the Status is reporting Auto-Weka started...

On Mon, Feb 20, 2017 at 5:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
I don't think so, but my understanding is that it should just move on to the next classifier configuration if a run with a particular configuration is not successful.

You may just have to experiment with the heap sizes. Perhaps half per JVM would be best. However, I don't know much about the inner workings of AutoWEKA.

Cheers,
Eibe

On 20/02/2017, at 8:36 PM, Bill <[hidden email]> wrote:

Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?
Also, as AutoWeka starts up a new instance of Weka and I have about 34 gb of ram, how much should I assign to AutoWeka versus how much in java_opt?
Is this acceptable?
weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 29024 -nBestConfigs 1 -metric errorRate -parallelRuns 1

On Mon, Feb 20, 2017 at 4:17 PM, Jenna <[hidden email]> wrote:
Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?

On Mon, Feb 20, 2017 at 7:25 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.

MergeManyValues can be used if you know exactly which values you want to merge.

Cheers,
Eibe

> On 20/02/2017, at 12:43 AM, Jenna <[hidden email]> wrote:
>
> Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?
>
>
> On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:

>
> > On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
> >
> > Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.
>
> Probably not necessary.
>
> > I am not running any other software but Weka actually.
>
> AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.
>
> > I think there may be some nominals with many values.
>
> OK, that might be the reason why the tree learners are running out of heap space then.
>
> Cheers,
> Eibe
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
> NAML
>
>
> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39463.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML




_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39468.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Lars Kotthoff
In reply to this post by Eibe Frank-2
> I don't think so, but my understanding is that it should just move on to the
> next classifier configuration if a run with a particular configuration is not
> successful.

That's correct. You can't at the moment control which classifiers are tried.

> You may just have to experiment with the heap sizes. Perhaps half per JVM
> would be best.

I would recommend giving most to Auto-WEKA, just like you've done. This is where
all the action happens; the "parent" JVM doesn't need a lot of memory.

Cheers,

Lars
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator
In reply to this post by Jenna
I would try to reduce the number of nominal values per attribute to something quite small. For example, if you have three attributes with just 100 nominal values each, and you build a complete tree from those three attributes, you already get 100*100*100 = 1 million leaf nodes.

Note that WEKA’s tree learners typically create Java objects for empty leaf nodes as well.

Cheers,
Eibe

> On 20/02/2017, at 9:30 PM, Jenna <[hidden email]> wrote:
>
> Thanks. I am running autoweka now. I used
> MergeInfrequentNominalValues
> to the extent that all the attributes, when viewed in the preprocess window, show graphs rather than saying something like "too many values to show".
> The configuration is:
> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 29024 -nBestConfigs 1 -metric errorRate -parallelRuns 1
>
>
> Although it is set for 15 minutes, it has been running for 30 minutes. The little bird is continuing to move and the Status is reporting Auto-Weka started...
>
> On Mon, Feb 20, 2017 at 5:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
> I don't think so, but my understanding is that it should just move on to the next classifier configuration if a run with a particular configuration is not successful.
>
> You may just have to experiment with the heap sizes. Perhaps half per JVM would be best. However, I don't know much about the inner workings of AutoWEKA.
>
> Cheers,
> Eibe
>
> On 20/02/2017, at 8:36 PM, Bill <[hidden email]> wrote:
>
>> Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?
>> Also, as AutoWeka starts up a new instance of Weka and I have about 34 gb of ram, how much should I assign to AutoWeka versus how much in java_opt?
>> Is this acceptable?
>> weka.classifiers.meta.AutoWEKAClassifier -seed 123 -timeLimit 15 -memLimit 29024 -nBestConfigs 1 -metric errorRate -parallelRuns 1
>>
>> On Mon, Feb 20, 2017 at 4:17 PM, Jenna <[hidden email]> wrote:
>> Thank you. Is there some way to control AutoWeka so that it does not try Random Forests?
>>
>> On Mon, Feb 20, 2017 at 7:25 AM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
>> Two filters that can potentially help with this are the MergeNominalValues filter (supervised version) and the (unsupervised) MergeInfrequentNominalValues filter. The former needs to be applied in conjunction with the FilteredClassifier but the latter can be applied as a preprocessing step.
>>
>> MergeManyValues can be used if you know exactly which values you want to merge.
>>
>> Cheers,
>> Eibe
>>
>> > On 20/02/2017, at 12:43 AM, Jenna <[hidden email]> wrote:
>> >
>> > Thank you. Would there be any filter that I could use for nominals that have many values instead of just deleting that variable. For example I have a nominal with 4000 different values and another with about 10,000. Would MergeManyValues be of any value?
>> >
>> >
>> > On Sun, Feb 19, 2017 at 12:08 PM, Eibe Frank-2 [via WEKA] <[hidden email]> wrote:
>>
>> >
>> > > On 19 Feb 2017, at 16:02, Jenna <[hidden email]> wrote:
>> > >
>> > > Hi. Thanks. I will resend the info about my system. Maybe Nabble cut it off because it was long. I can send it in a few messages.
>> >
>> > Probably not necessary.
>> >
>> > > I am not running any other software but Weka actually.
>> >
>> > AutoWEKA spawns its own Java Virtual Machine in a separate process, so you have one JVM running the main WEKA process and another one running AutoWEKA. That might be why you are running out of RAM.
>> >
>> > > I think there may be some nominals with many values.
>> >
>> > OK, that might be the reason why the tree learners are running out of heap space then.
>> >
>> > Cheers,
>> > Eibe
>> >
>> > _______________________________________________
>> > Wekalist mailing list
>> > Send posts to: [hidden email]
>> > List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> > List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>> >
>> >
>> > If you reply to this email, your message will be added to the discussion below:
>> > http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39459.html
>> > To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
>> > NAML
>> >
>> >
>> > View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
>> > Sent from the WEKA mailing list archive at Nabble.com.
>> > _______________________________________________
>> > Wekalist mailing list
>> > Send posts to: [hidden email]
>> > List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> > List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>> _______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>>
>> If you reply to this email, your message will be added to the discussion below:
>> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39463.html
>> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
>> NAML
>>
>>
>> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
>> Sent from the WEKA mailing list archive at Nabble.com.
>>
>> _______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>
>> _______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39468.html
> To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
> NAML
>
>
> View this message in context: Re: Weka Explorer freeze in Windows 34gb memory
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
12
Loading...