Quantcast

Weka Explorer freeze in Windows 34gb memory

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Weka Explorer freeze in Windows 34gb memory

Jenna
I am running weka Explorer in the cloud (Google Cloud) on Windows with a 34gb memory and 6 cpus.
The dataset is about 125mb, has 1000 features and about 30,000 rows.
Sometimes, mostly when doing feature selection, the program will run, the little Weka bird at bottom right of the screen will stop moving after a certain period of time (say 1 minute), the Start button will become available, but in the status bar at the bottom it still says "evaluating on training data..." and no results show in the Attribute selection output window. Here is a 10 second video of this behaviour
https://drive.google.com/open?id=0B9eTJeTneln6N2poQmpfT04zTFE
What is happening and why. I don't believe it is a lack of computing power since there is a 6 vCPUs, 34 GB configuration.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Mark Hall
Which version of Weka are you running? Perhaps Weka is running out of memory. Older versions of Weka had a 1Gb default heap size setting for the JVM. If you launch Weka with the console option (Windows), or from a terminal *nix, then you might see some exceptions/errors printed. You can also check the weka.log file in ~/wekafiles.

Cheers,
Mark.

On 9/01/17, 10:16 PM, "Jenna" <[hidden email] on behalf of [hidden email]> wrote:

    I am running weka Explorer in the cloud (Google Cloud) on Windows with a 34gb
    memory and 6 cpus.
    The dataset is about 125mb, has 1000 features and about 30,000 rows.
    Sometimes, mostly when doing feature selection, the program will run, the
    little Weka bird at bottom right of the screen will stop moving after a
    certain period of time (say 1 minute), the Start button will become
    available, but in the status bar at the bottom it still says "evaluating on
    training data..." and no results show in the Attribute selection output
    window. Here is a 10 second video of this behaviour
    https://drive.google.com/open?id=0B9eTJeTneln6N2poQmpfT04zTFE
    What is happening and why. I don't believe it is a lack of computing power
    since there is a 6 vCPUs, 34 GB configuration.
   
   
   
    --
    View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155.html
    Sent from the WEKA mailing list archive at Nabble.com.
    _______________________________________________
    Wekalist mailing list
    Send posts to: [hidden email]
    List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
    List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
   


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thanks. I am running 3.9.1

Here is part of my RunWeka.ini file.
I see I had a conflict but I don't think it was having an effect with this: -Xmx4g


# setups (prefixed with "cmd_")
cmd_default=javaw -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" #mainclass#
cmd_console=cmd.exe /K start cmd.exe /K "java -Xss#maxstack# -Dfile.encoding=#fileEncoding# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath \"#wekajar#;#cp#\" #mainclass#"
cmd_explorer=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.explorer.Explorer
cmd_knowledgeFlow=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.knowledgeflow.KnowledgeFlow

# placeholders ("#bla#" in command gets replaced with content of key "bla")
# Note: "#wekajar#" gets replaced by the launcher class, since that jar gets
#       provided as parameter
maxstack=20m
-Xmx4g
# The MDI GUI
#mainclass=weka.gui.Main
# The GUIChooser
mainclass=weka.gui.GUIChooser
# The file encoding; use "utf-8" instead of "Cp1252" to display UTF-8 characters in the 
# GUI, e.g., the Explorer
fileEncoding=Cp1252
maxheap=20072M


Here is Weka.logs:

2017-01-09 13:40:48 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:10 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (39321 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:14 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (41687 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:19 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (46419 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:41:42 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1
2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (55883 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException
2017-01-09 13:43:08 weka.gui.explorer.PreprocessPanel$21 run
INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 33.0 -S 1
2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run
INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P33.0-S1 (62129 instances)
java.lang.NullPointerException
weka.core.Instances.<init>(Instances.java:179)
weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
java.awt.event.InvocationEvent.dispatch(Unknown Source)
java.awt.EventQueue.dispatchEventImpl(Unknown Source)
java.awt.EventQueue.access$500(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.awt.EventQueue$3.run(Unknown Source)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
java.awt.EventQueue.dispatchEvent(Unknown Source)
java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.pumpEvents(Unknown Source)
java.awt.EventDispatchThread.run(Unknown Source)

at weka.core.Instances.<init>(Instances.java:179)
at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)
at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)
at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)
at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run
INFO: java.lang.NullPointerException

On Tue, Jan 10, 2017 at 3:22 AM, Mark Hall [via WEKA] <[hidden email]> wrote:
Which version of Weka are you running? Perhaps Weka is running out of memory. Older versions of Weka had a 1Gb default heap size setting for the JVM. If you launch Weka with the console option (Windows), or from a terminal *nix, then you might see some exceptions/errors printed. You can also check the weka.log file in ~/wekafiles.

Cheers,
Mark.

On 9/01/17, 10:16 PM, "Jenna" <[hidden email] on behalf of [hidden email]> wrote:

    I am running weka Explorer in the cloud (Google Cloud) on Windows with a 34gb
    memory and 6 cpus.
    The dataset is about 125mb, has 1000 features and about 30,000 rows.
    Sometimes, mostly when doing feature selection, the program will run, the
    little Weka bird at bottom right of the screen will stop moving after a
    certain period of time (say 1 minute), the Start button will become
    available, but in the status bar at the bottom it still says "evaluating on
    training data..." and no results show in the Attribute selection output
    window. Here is a 10 second video of this behaviour
    https://drive.google.com/open?id=0B9eTJeTneln6N2poQmpfT04zTFE
    What is happening and why. I don't believe it is a lack of computing power
    since there is a 6 vCPUs, 34 GB configuration.
   
   
   
    --
    View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155.html
    Sent from the WEKA mailing list archive at Nabble.com.
    _______________________________________________
    Wekalist mailing list
    Send posts to: [hidden email]
    List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
    List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
   


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



If you reply to this email, your message will be added to the discussion below:
http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39157.html
To unsubscribe from Weka Explorer freeze in Windows 34gb memory, click here.
NAML

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Mark Hall

Hmm. Is that the full log? I don't see any entries pertaining to attribute selection, just filtering from the PreprocessPanel. I'm not sure what is causing the NPEs in the log, I can't seem to replicate them on my machine when filtering some benchmark datasets. Are you using an Oracle JVM?

 

Note that the maxheap property is no longer used in the RunWeka.ini file. We let the JVM set the heap size according to how much RAM is available on the machine. If you want to force a particular maximum heap size then the JAVA_OPTS environment variable can be used to specify a –Xmx setting.

 

Cheers,

Mark.

 

 

From: <[hidden email]> on behalf of Jenna <[hidden email]>
Reply-To: "Weka machine learning workbench list." <[hidden email]>
Date: Tuesday, 10 January 2017 at 10:35 AM
To: "Weka machine learning workbench list." <[hidden email]>
Subject: Re: [Wekalist] Weka Explorer freeze in Windows 34gb memory

 

Thanks. I am running 3.9.1

 

Here is part of my RunWeka.ini file.

I see I had a conflict but I don't think it was having an effect with this: -Xmx4g

 

 

# setups (prefixed with "cmd_")

cmd_default=javaw -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" #mainclass#

cmd_console=cmd.exe /K start cmd.exe /K "java -Xss#maxstack# -Dfile.encoding=#fileEncoding# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath \"#wekajar#;#cp#\" #mainclass#"

cmd_explorer=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.explorer.Explorer

cmd_knowledgeFlow=java -Dfile.encoding=#fileEncoding# -Xss#maxstack# -Djava.net.useSystemProxies=#systemProxies# #javaOpts# -classpath "#wekajar#;#cp#" weka.gui.knowledgeflow.KnowledgeFlow

 

# placeholders ("#bla#" in command gets replaced with content of key "bla")

# Note: "#wekajar#" gets replaced by the launcher class, since that jar gets

#       provided as parameter

maxstack=20m

-Xmx4g

# The MDI GUI

#mainclass=weka.gui.Main

# The GUIChooser

mainclass=weka.gui.GUIChooser

# The file encoding; use "utf-8" instead of "Cp1252" to display UTF-8 characters in the 

# GUI, e.g., the Explorer

fileEncoding=Cp1252

maxheap=20072M

 

 

Here is Weka.logs:

 

2017-01-09 13:40:48 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:10 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (39321 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:41:12 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:14 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (41687 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:41:17 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:19 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (46419 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:41:34 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:41:42 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 100.0 -S 1

2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1 (55883 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:42:45 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException

2017-01-09 13:43:08 weka.gui.explorer.PreprocessPanel$21 run

INFO: Command: weka.filters.supervised.instance.SMOTE -C 0 -K 5 -P 33.0 -S 1

2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run

INFO: Base relation is now pay_combine-weka.filters.unsupervised.attribute.Remove-R145-184,363-407,413-417,438-457,520-654-weka.filters.unsupervised.attribute.Remove-R227-241,253-347,395-399,410-514,536-540,654-713-weka.filters.unsupervised.attribute.Remove-R307-315,334-337,429-445-weka.filters.unsupervised.attribute.Remove-R325-390-weka.filters.unsupervised.attribute.Remove-R105,200-211,232-237,307-348-weka.filters.unsupervised.attribute.StringToNominal-Rfirst-last-weka.filters.unsupervised.attribute.Remove-R1,294-297,299-weka.filters.unsupervised.attribute.Remove-R32,78,86,104,275-276,279-286-weka.filters.unsupervised.attribute.Remove-R14,36,63,65,70,83,87,92,119,140,145,150,155,160,165,170,175,180,185,190,195,200,205,210,217,219,227,232,237,242,247,252,257,262,267-weka.filters.unsupervised.attribute.Remove-V-R2,30,35,41,89,99,244-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P100.0-S1-weka.filters.supervised.instance.SMOTE-C0-K5-P33.0-S1 (62129 instances)

java.lang.NullPointerException

        weka.core.Instances.<init>(Instances.java:179)

        weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        java.awt.event.InvocationEvent.dispatch(Unknown Source)

        java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        java.awt.EventQueue.access$500(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.awt.EventQueue$3.run(Unknown Source)

        java.security.AccessController.doPrivileged(Native Method)

        java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        java.awt.EventQueue.dispatchEvent(Unknown Source)

        java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        java.awt.EventDispatchThread.run(Unknown Source)

 

        at weka.core.Instances.<init>(Instances.java:179)

        at weka.gui.explorer.ClassifierPanel.updateCapabilitiesFilter(ClassifierPanel.java:3252)

        at weka.gui.explorer.ClassifierPanel.capabilitiesFilterChanged(ClassifierPanel.java:3292)

        at weka.gui.explorer.Explorer.notifyCapabilitiesFilterListener(Explorer.java:343)

        at weka.gui.explorer.PreprocessPanel$20.run(PreprocessPanel.java:749)

        at java.awt.event.InvocationEvent.dispatch(Unknown Source)

        at java.awt.EventQueue.dispatchEventImpl(Unknown Source)

        at java.awt.EventQueue.access$500(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.awt.EventQueue$3.run(Unknown Source)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)

        at java.awt.EventQueue.dispatchEvent(Unknown Source)

        at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)

        at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.pumpEvents(Unknown Source)

        at java.awt.EventDispatchThread.run(Unknown Source)

2017-01-09 13:47:32 weka.gui.explorer.PreprocessPanel$20 run

INFO: java.lang.NullPointerException


_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Jenna
Thank you Mark. How do I set the JAVA_OPTS environment variable in Windows Server 2012. It is currently not in the set of Environment Variables. Do I just create it as JAVA_OPTS in the user variables (system variables has the New button grayed out). And then set the Variable value to –Xmx20gb ?
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Weka Explorer freeze in Windows 34gb memory

Eibe Frank-2
Administrator
Yes, although I think you might need to use _JAVA_OPTIONS rather than JAVA_OPTS:

  http://stackoverflow.com/questions/28327620/difference-between-java-options-java-tool-options-and-java-opts

Note that _JAVA_OPTIONS appears to be undocumented. There is also JAVA_TOOL_OPTIONS but _JAVA_OPTIONS has the advantage that it overrides any command-line settings given when the java command is executed (e.g., a different -Xmx setting provided in WEKA’s default start-up script for Windows).

I normally use _JAVA_OPTIONS. It seems to work fine and provides an easy way to change the default heap size, etc., without having to fiddle with start-up scripts.

Cheers,
Eibe

> On 11/01/2017, at 8:10 PM, Jenna <[hidden email]> wrote:
>
> Thank you Mark. How do I set the JAVA_OPTS environment variable in Windows
> Server 2012. It is currently not in the set of Environment Variables. Do I
> just create it as JAVA_OPTS in the user variables (system variables has the
> New button grayed out). And then set the Variable value to –Xmx20gb ?
>
>
>
> --
> View this message in context: http://weka.8497.n7.nabble.com/Weka-Explorer-freeze-in-Windows-34gb-memory-tp39155p39168.html
> Sent from the WEKA mailing list archive at Nabble.com.
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Loading...