Quantcast

Measuring accuracy and efficiency of association rules!

classic Classic list List threaded Threaded
12 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Measuring accuracy and efficiency of association rules!

Bhupesh Rawat
>
> Dear Sir/Madam,
>
   How to measure the Accuracy and Efficiency(running time and space)
of association
   rules discovered through WEKA.




--
Thanks & Regards
Bhupesh Rawat.
Ph.D Scholar
Department of Computer Science,Babasaheb Bhimrao Ambedkar University
Vidya Vihar,Rai Bareilly road(Lucknow)
Ph. No: +91-9897065948

...........................................................................................................................
*A man is the best judge of himself and he has to pay the price for what he
does.*
...........................................................................................................................
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Eibe Frank-2
Administrator
The running time is output under “Elapsed time” when you run Apriori.

The size of the final Apriori model as a serialised Java object can be established saving it to a file and considering the file size. Note that this is different from the size of the object in memory (see, e.g., http://stackoverflow.com/questions/7146559/serialized-object-size-vs-in-memory-object-size-in-java#7146941).

I don’t know of a good way to measure peak memory consumption of a Java program (after garbage collection). A crude way would be to run the program from the command-line (to avoid overhead associated with the GUIs) with different maximum heap sizes, e.g., increasing the heap size until the program runs through. Another option is to look at the heap size in a profiler (e.g., visualvm), enforcing garbage collection before a readout.

Cheers,
Eibe

> On 11/02/2017, at 10:27 PM, Bhupesh Rawat <[hidden email]> wrote:
>
>>
>> Dear Sir/Madam,
>>
>   How to measure the Accuracy and Efficiency(running time and space)
> of association
>   rules discovered through WEKA.
>
>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Peter Reutemann
> The size of the final Apriori model as a serialised Java object can be established saving it to a file and considering the file size. Note that this is different from the size of the object in memory (see, e.g., http://stackoverflow.com/questions/7146559/serialized-object-size-vs-in-memory-object-size-in-java#7146941).
>
> I don’t know of a good way to measure peak memory consumption of a Java program (after garbage collection). A crude way would be to run the program from the command-line (to avoid overhead associated with the GUIs) with different maximum heap sizes, e.g., increasing the heap size until the program runs through. Another option is to look at the heap size in a profiler (e.g., visualvm), enforcing garbage collection before a readout.

You can use the sizeofag javaagent for determining the size of a Java object:
https://github.com/fracpete/sizeofag

Credits to Maxim Zakharenkov, who wrote the original code.

Cheers, Peter
--
Peter Reutemann
Dept. of Computer Science
University of Waikato, NZ
+64 (7) 858-5174
http://www.cms.waikato.ac.nz/~fracpete/
http://www.data-mining.co.nz/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Bhupesh Rawat
Dear Sir/Madam

I have discovered some rules through weka. Could you tell me how to measure  the accuracy of those rules.







On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann <[hidden email]> wrote:
> The size of the final Apriori model as a serialised Java object can be established saving it to a file and considering the file size. Note that this is different from the size of the object in memory (see, e.g., http://stackoverflow.com/questions/7146559/serialized-object-size-vs-in-memory-object-size-in-java#7146941).
>
> I don’t know of a good way to measure peak memory consumption of a Java program (after garbage collection). A crude way would be to run the program from the command-line (to avoid overhead associated with the GUIs) with different maximum heap sizes, e.g., increasing the heap size until the program runs through. Another option is to look at the heap size in a profiler (e.g., visualvm), enforcing garbage collection before a readout.

You can use the sizeofag javaagent for determining the size of a Java object:
https://github.com/fracpete/sizeofag

Credits to Maxim Zakharenkov, who wrote the original code.

Cheers, Peter
--
Peter Reutemann
Dept. of Computer Science
University of Waikato, NZ
+64 (7) 858-5174
http://www.cms.waikato.ac.nz/~fracpete/
http://www.data-mining.co.nz/
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



--
Thanks & Regards
Bhupesh Rawat.
Ph.D Scholar
Department of Computer Science,Babasaheb Bhimrao Ambedkar University
Vidya Vihar,Rai Bareilly road(Lucknow)
Ph. No: +91-9897065948

...........................................................................................................................
*A man is the best judge of himself and he has to pay the price for what he
does.*
...........................................................................................................................




_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Eibe Frank-2
Administrator
You mean beyond confidence, lift, or one the other metrics that you can get in the output of each rule? This is a tough question. One way may be to use the association rule mining algorithm to build classification rules and then evaluate the accuracy of those classification rules. We had a paper on this quite a while back:

Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification to evaluate the output of confidence-based association rule mining. In Australasian Joint Conference on Artificial Intelligence (pp. 538-549). Springer Berlin Heidelberg.

I suppose you could also evaluate the individual association rules on a separate test set, by computing the confidence measure, etc., on the test set for each rule, but this functionality is not provided by WEKA.

Cheers,
Eibe

> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>
> Dear Sir/Madam
>
> I have discovered some rules through weka. Could you tell me how to measure  the accuracy of those rules.
>
>
>
>
>
>
>
> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann <[hidden email]> wrote:
> > The size of the final Apriori model as a serialised Java object can be established saving it to a file and considering the file size. Note that this is different from the size of the object in memory (see, e.g., http://stackoverflow.com/questions/7146559/serialized-object-size-vs-in-memory-object-size-in-java#7146941).
> >
> > I don’t know of a good way to measure peak memory consumption of a Java program (after garbage collection). A crude way would be to run the program from the command-line (to avoid overhead associated with the GUIs) with different maximum heap sizes, e.g., increasing the heap size until the program runs through. Another option is to look at the heap size in a profiler (e.g., visualvm), enforcing garbage collection before a readout.
>
> You can use the sizeofag javaagent for determining the size of a Java object:
> https://github.com/fracpete/sizeofag
>
> Credits to Maxim Zakharenkov, who wrote the original code.
>
> Cheers, Peter
> --
> Peter Reutemann
> Dept. of Computer Science
> University of Waikato, NZ
> +64 (7) 858-5174
> http://www.cms.waikato.ac.nz/~fracpete/
> http://www.data-mining.co.nz/
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
>
>
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Bhupesh Rawat

Thank you so much for the response!!

On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
You mean beyond confidence, lift, or one the other metrics that you can get in the output of each rule? This is a tough question. One way may be to use the association rule mining algorithm to build classification rules and then evaluate the accuracy of those classification rules. We had a paper on this quite a while back:

Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification to evaluate the output of confidence-based association rule mining. In Australasian Joint Conference on Artificial Intelligence (pp. 538-549). Springer Berlin Heidelberg.

I suppose you could also evaluate the individual association rules on a separate test set, by computing the confidence measure, etc., on the test set for each rule, but this functionality is not provided by WEKA.

Cheers,
Eibe

> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>
> Dear Sir/Madam
>
> I have discovered some rules through weka. Could you tell me how to measure  the accuracy of those rules.
>
>
>
>
>
>
>
> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann <[hidden email]> wrote:
> > The size of the final Apriori model as a serialised Java object can be established saving it to a file and considering the file size. Note that this is different from the size of the object in memory (see, e.g., http://stackoverflow.com/questions/7146559/serialized-object-size-vs-in-memory-object-size-in-java#7146941).
> >
> > I don’t know of a good way to measure peak memory consumption of a Java program (after garbage collection). A crude way would be to run the program from the command-line (to avoid overhead associated with the GUIs) with different maximum heap sizes, e.g., increasing the heap size until the program runs through. Another option is to look at the heap size in a profiler (e.g., visualvm), enforcing garbage collection before a readout.
>
> You can use the sizeofag javaagent for determining the size of a Java object:
> https://github.com/fracpete/sizeofag
>
> Credits to Maxim Zakharenkov, who wrote the original code.
>
> Cheers, Peter
> --
> Peter Reutemann
> Dept. of Computer Science
> University of Waikato, NZ
> +64 (7) 858-5174
> http://www.cms.waikato.ac.nz/~fracpete/
> http://www.data-mining.co.nz/
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
>
>
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Bhupesh Rawat
I have a small dataset which contains student enrolment data in
various courses. If a student has selected a particular course it is
indicated by ‘Y’ else ‘N’ is used. I have also attached a file for
better understanding of the dataset. I am interested in knowing if it
is possible to measure the accuracy of the association rules with this
dataset by the proposed approach in your paper.

On 2/23/17, Bhupesh Rawat <[hidden email]> wrote:

> Thank you so much for the response!!
> On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
>
>> You mean beyond confidence, lift, or one the other metrics that you can
>> get in the output of each rule? This is a tough question. One way may be
>> to
>> use the association rule mining algorithm to build classification rules
>> and
>> then evaluate the accuracy of those classification rules. We had a paper
>> on
>> this quite a while back:
>>
>> Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification
>> to evaluate the output of confidence-based association rule mining. In
>> Australasian Joint Conference on Artificial Intelligence (pp. 538-549).
>> Springer Berlin Heidelberg.
>>
>> I suppose you could also evaluate the individual association rules on a
>> separate test set, by computing the confidence measure, etc., on the test
>> set for each rule, but this functionality is not provided by WEKA.
>>
>> Cheers,
>> Eibe
>>
>> > On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>> >
>> > Dear Sir/Madam
>> >
>> > I have discovered some rules through weka. Could you tell me how to
>> measure  the accuracy of those rules.
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann
>> > <[hidden email]>
>> wrote:
>> > > The size of the final Apriori model as a serialised Java object can
>> > > be
>> established saving it to a file and considering the file size. Note that
>> this is different from the size of the object in memory (see, e.g.,
>> http://stackoverflow.com/questions/7146559/serialized-
>> object-size-vs-in-memory-object-size-in-java#7146941).
>> > >
>> > > I don’t know of a good way to measure peak memory consumption of a
>> Java program (after garbage collection). A crude way would be to run the
>> program from the command-line (to avoid overhead associated with the
>> GUIs)
>> with different maximum heap sizes, e.g., increasing the heap size until
>> the
>> program runs through. Another option is to look at the heap size in a
>> profiler (e.g., visualvm), enforcing garbage collection before a readout.
>> >
>> > You can use the sizeofag javaagent for determining the size of a Java
>> object:
>> > https://github.com/fracpete/sizeofag
>> >
>> > Credits to Maxim Zakharenkov, who wrote the original code.
>> >
>> > Cheers, Peter
>> > --
>> > Peter Reutemann
>> > Dept. of Computer Science
>> > University of Waikato, NZ
>> > +64 (7) 858-5174
>> > http://www.cms.waikato.ac.nz/~fracpete/
>> > http://www.data-mining.co.nz/
>> > _______________________________________________
>> > Wekalist mailing list
>> > Send posts to: [hidden email]
>> > List info and subscription status: https://list.waikato.ac.nz/
>> mailman/listinfo/wekalist
>> > List etiquette: http://www.cs.waikato.ac.nz/~
>> ml/weka/mailinglist_etiquette.html
>> >
>> >
>> >
>> > --
>> > Thanks & Regards
>> > Bhupesh Rawat.
>> > Ph.D Scholar
>> > Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>> > Vidya Vihar,Rai Bareilly road(Lucknow)
>> > Ph. No: +91-9897065948
>> >
>> > ............................................................
>> ...............................................................
>> > *A man is the best judge of himself and he has to pay the price for
>> > what
>> he
>> > does.*
>> > ............................................................
>> ...............................................................
>> >
>> >
>> >
>> > _______________________________________________
>> > Wekalist mailing list
>> > Send posts to: [hidden email]
>> > List info and subscription status: https://list.waikato.ac.nz/
>> mailman/listinfo/wekalist
>> > List etiquette: http://www.cs.waikato.ac.nz/~
>> ml/weka/mailinglist_etiquette.html
>>
>> _______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status: https://list.waikato.ac.nz/
>> mailman/listinfo/wekalist
>> List etiquette: http://www.cs.waikato.ac.nz/~
>> ml/weka/mailinglist_etiquette.html
>>
>

--
Thanks & Regards
Bhupesh Rawat.
Ph.D Scholar
Department of Computer Science,Babasaheb Bhimrao Ambedkar University
Vidya Vihar,Rai Bareilly road(Lucknow)
Ph. No: +91-9897065948

...........................................................................................................................
*A man is the best judge of himself and he has to pay the price for what he
does.*
...........................................................................................................................

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

students' data after preprocessin.xlsx (16K) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Eibe Frank-2
Administrator
No, not really. However, the dataset is quite small. You could just run a classification rule learner such as JRip or PART on the data, treating each of the attributes in turn as the class attribute. Then you can estimate classification accuracy using cross-validation.

You could also create combinations of attributes using the CartesionProduct filter.

Cheers,
Eibe

> On 24/02/2017, at 3:11 AM, Bhupesh Rawat <[hidden email]> wrote:
>
> I have a small dataset which contains student enrolment data in
> various courses. If a student has selected a particular course it is
> indicated by ‘Y’ else ‘N’ is used. I have also attached a file for
> better understanding of the dataset. I am interested in knowing if it
> is possible to measure the accuracy of the association rules with this
> dataset by the proposed approach in your paper.
>
> On 2/23/17, Bhupesh Rawat <[hidden email]> wrote:
>> Thank you so much for the response!!
>> On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
>>
>>> You mean beyond confidence, lift, or one the other metrics that you can
>>> get in the output of each rule? This is a tough question. One way may be
>>> to
>>> use the association rule mining algorithm to build classification rules
>>> and
>>> then evaluate the accuracy of those classification rules. We had a paper
>>> on
>>> this quite a while back:
>>>
>>> Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification
>>> to evaluate the output of confidence-based association rule mining. In
>>> Australasian Joint Conference on Artificial Intelligence (pp. 538-549).
>>> Springer Berlin Heidelberg.
>>>
>>> I suppose you could also evaluate the individual association rules on a
>>> separate test set, by computing the confidence measure, etc., on the test
>>> set for each rule, but this functionality is not provided by WEKA.
>>>
>>> Cheers,
>>> Eibe
>>>
>>>> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>>>>
>>>> Dear Sir/Madam
>>>>
>>>> I have discovered some rules through weka. Could you tell me how to
>>> measure  the accuracy of those rules.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann
>>>> <[hidden email]>
>>> wrote:
>>>>> The size of the final Apriori model as a serialised Java object can
>>>>> be
>>> established saving it to a file and considering the file size. Note that
>>> this is different from the size of the object in memory (see, e.g.,
>>> http://stackoverflow.com/questions/7146559/serialized-
>>> object-size-vs-in-memory-object-size-in-java#7146941).
>>>>>
>>>>> I don’t know of a good way to measure peak memory consumption of a
>>> Java program (after garbage collection). A crude way would be to run the
>>> program from the command-line (to avoid overhead associated with the
>>> GUIs)
>>> with different maximum heap sizes, e.g., increasing the heap size until
>>> the
>>> program runs through. Another option is to look at the heap size in a
>>> profiler (e.g., visualvm), enforcing garbage collection before a readout.
>>>>
>>>> You can use the sizeofag javaagent for determining the size of a Java
>>> object:
>>>> https://github.com/fracpete/sizeofag
>>>>
>>>> Credits to Maxim Zakharenkov, who wrote the original code.
>>>>
>>>> Cheers, Peter
>>>> --
>>>> Peter Reutemann
>>>> Dept. of Computer Science
>>>> University of Waikato, NZ
>>>> +64 (7) 858-5174
>>>> http://www.cms.waikato.ac.nz/~fracpete/
>>>> http://www.data-mining.co.nz/
>>>> _______________________________________________
>>>> Wekalist mailing list
>>>> Send posts to: [hidden email]
>>>> List info and subscription status: https://list.waikato.ac.nz/
>>> mailman/listinfo/wekalist
>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>> ml/weka/mailinglist_etiquette.html
>>>>
>>>>
>>>>
>>>> --
>>>> Thanks & Regards
>>>> Bhupesh Rawat.
>>>> Ph.D Scholar
>>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>>>> Vidya Vihar,Rai Bareilly road(Lucknow)
>>>> Ph. No: +91-9897065948
>>>>
>>>> ............................................................
>>> ...............................................................
>>>> *A man is the best judge of himself and he has to pay the price for
>>>> what
>>> he
>>>> does.*
>>>> ............................................................
>>> ...............................................................
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Wekalist mailing list
>>>> Send posts to: [hidden email]
>>>> List info and subscription status: https://list.waikato.ac.nz/
>>> mailman/listinfo/wekalist
>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>> ml/weka/mailinglist_etiquette.html
>>>
>>> _______________________________________________
>>> Wekalist mailing list
>>> Send posts to: [hidden email]
>>> List info and subscription status: https://list.waikato.ac.nz/
>>> mailman/listinfo/wekalist
>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>> ml/weka/mailinglist_etiquette.html
>>>
>>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
> <students' data after preprocessin.xlsx>_______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Bhupesh Rawat
Sir,

How could i perform these two task seperately(applying classification
rule learner and estimating classification accuracy). The accuracy is
estimated each time i run the classifier on the dataset.



On 2/24/17, Eibe Frank <[hidden email]> wrote:

> No, not really. However, the dataset is quite small. You could just run a
> classification rule learner such as JRip or PART on the data, treating each
> of the attributes in turn as the class attribute. Then you can estimate
> classification accuracy using cross-validation.
>
> You could also create combinations of attributes using the CartesionProduct
> filter.
>
> Cheers,
> Eibe
>
>> On 24/02/2017, at 3:11 AM, Bhupesh Rawat <[hidden email]> wrote:
>>
>> I have a small dataset which contains student enrolment data in
>> various courses. If a student has selected a particular course it is
>> indicated by ‘Y’ else ‘N’ is used. I have also attached a file for
>> better understanding of the dataset. I am interested in knowing if it
>> is possible to measure the accuracy of the association rules with this
>> dataset by the proposed approach in your paper.
>>
>> On 2/23/17, Bhupesh Rawat <[hidden email]> wrote:
>>> Thank you so much for the response!!
>>> On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
>>>
>>>> You mean beyond confidence, lift, or one the other metrics that you can
>>>> get in the output of each rule? This is a tough question. One way may be
>>>> to
>>>> use the association rule mining algorithm to build classification rules
>>>> and
>>>> then evaluate the accuracy of those classification rules. We had a paper
>>>> on
>>>> this quite a while back:
>>>>
>>>> Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification
>>>> to evaluate the output of confidence-based association rule mining. In
>>>> Australasian Joint Conference on Artificial Intelligence (pp. 538-549).
>>>> Springer Berlin Heidelberg.
>>>>
>>>> I suppose you could also evaluate the individual association rules on a
>>>> separate test set, by computing the confidence measure, etc., on the
>>>> test
>>>> set for each rule, but this functionality is not provided by WEKA.
>>>>
>>>> Cheers,
>>>> Eibe
>>>>
>>>>> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>>>>>
>>>>> Dear Sir/Madam
>>>>>
>>>>> I have discovered some rules through weka. Could you tell me how to
>>>> measure  the accuracy of those rules.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann
>>>>> <[hidden email]>
>>>> wrote:
>>>>>> The size of the final Apriori model as a serialised Java object can
>>>>>> be
>>>> established saving it to a file and considering the file size. Note that
>>>> this is different from the size of the object in memory (see, e.g.,
>>>> http://stackoverflow.com/questions/7146559/serialized-
>>>> object-size-vs-in-memory-object-size-in-java#7146941).
>>>>>>
>>>>>> I don’t know of a good way to measure peak memory consumption of a
>>>> Java program (after garbage collection). A crude way would be to run the
>>>> program from the command-line (to avoid overhead associated with the
>>>> GUIs)
>>>> with different maximum heap sizes, e.g., increasing the heap size until
>>>> the
>>>> program runs through. Another option is to look at the heap size in a
>>>> profiler (e.g., visualvm), enforcing garbage collection before a
>>>> readout.
>>>>>
>>>>> You can use the sizeofag javaagent for determining the size of a Java
>>>> object:
>>>>> https://github.com/fracpete/sizeofag
>>>>>
>>>>> Credits to Maxim Zakharenkov, who wrote the original code.
>>>>>
>>>>> Cheers, Peter
>>>>> --
>>>>> Peter Reutemann
>>>>> Dept. of Computer Science
>>>>> University of Waikato, NZ
>>>>> +64 (7) 858-5174
>>>>> http://www.cms.waikato.ac.nz/~fracpete/
>>>>> http://www.data-mining.co.nz/
>>>>> _______________________________________________
>>>>> Wekalist mailing list
>>>>> Send posts to: [hidden email]
>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>> mailman/listinfo/wekalist
>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>> ml/weka/mailinglist_etiquette.html
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thanks & Regards
>>>>> Bhupesh Rawat.
>>>>> Ph.D Scholar
>>>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>>>>> Vidya Vihar,Rai Bareilly road(Lucknow)
>>>>> Ph. No: +91-9897065948
>>>>>
>>>>> ............................................................
>>>> ...............................................................
>>>>> *A man is the best judge of himself and he has to pay the price for
>>>>> what
>>>> he
>>>>> does.*
>>>>> ............................................................
>>>> ...............................................................
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Wekalist mailing list
>>>>> Send posts to: [hidden email]
>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>> mailman/listinfo/wekalist
>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>> ml/weka/mailinglist_etiquette.html
>>>>
>>>> _______________________________________________
>>>> Wekalist mailing list
>>>> Send posts to: [hidden email]
>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>> mailman/listinfo/wekalist
>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>> ml/weka/mailinglist_etiquette.html
>>>>
>>>
>>
>>
>> --
>> Thanks & Regards
>> Bhupesh Rawat.
>> Ph.D Scholar
>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>> Vidya Vihar,Rai Bareilly road(Lucknow)
>> Ph. No: +91-9897065948
>>
>> ...........................................................................................................................
>> *A man is the best judge of himself and he has to pay the price for what
>> he
>> does.*
>> ...........................................................................................................................
>> <students' data after
>> preprocessin.xlsx>_______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status:
>> https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> List etiquette:
>> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status:
> https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette:
> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>


--
Thanks & Regards
Bhupesh Rawat.
Ph.D Scholar
Department of Computer Science,Babasaheb Bhimrao Ambedkar University
Vidya Vihar,Rai Bareilly road(Lucknow)
Ph. No: +91-9897065948

...........................................................................................................................
*A man is the best judge of himself and he has to pay the price for what he
does.*
...........................................................................................................................
_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Eibe Frank-2
Administrator
In the Explorer, there is no way to turn off evaluation completely. You could use the command-line interface or the KnowledgeFlow GUI though.

Having said this, if you evaluate on the training set, the runtime overhead is quite small if you apply a rule learner.

Note also that the Explorer always outputs the classification model for the *full* dataset loaded into the Preprocess panel, regardless of which evaluation metric you choose, i.e., you will get the rule set for the full dataset regardless of the evaluation method you use.

Cheers,
Eibe

> On 26/02/2017, at 8:07 PM, Bhupesh Rawat <[hidden email]> wrote:
>
> Sir,
>
> How could i perform these two task seperately(applying classification
> rule learner and estimating classification accuracy). The accuracy is
> estimated each time i run the classifier on the dataset.
>
>
>
> On 2/24/17, Eibe Frank <[hidden email]> wrote:
>> No, not really. However, the dataset is quite small. You could just run a
>> classification rule learner such as JRip or PART on the data, treating each
>> of the attributes in turn as the class attribute. Then you can estimate
>> classification accuracy using cross-validation.
>>
>> You could also create combinations of attributes using the CartesionProduct
>> filter.
>>
>> Cheers,
>> Eibe
>>
>>> On 24/02/2017, at 3:11 AM, Bhupesh Rawat <[hidden email]> wrote:
>>>
>>> I have a small dataset which contains student enrolment data in
>>> various courses. If a student has selected a particular course it is
>>> indicated by ‘Y’ else ‘N’ is used. I have also attached a file for
>>> better understanding of the dataset. I am interested in knowing if it
>>> is possible to measure the accuracy of the association rules with this
>>> dataset by the proposed approach in your paper.
>>>
>>> On 2/23/17, Bhupesh Rawat <[hidden email]> wrote:
>>>> Thank you so much for the response!!
>>>> On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
>>>>
>>>>> You mean beyond confidence, lift, or one the other metrics that you can
>>>>> get in the output of each rule? This is a tough question. One way may be
>>>>> to
>>>>> use the association rule mining algorithm to build classification rules
>>>>> and
>>>>> then evaluate the accuracy of those classification rules. We had a paper
>>>>> on
>>>>> this quite a while back:
>>>>>
>>>>> Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification
>>>>> to evaluate the output of confidence-based association rule mining. In
>>>>> Australasian Joint Conference on Artificial Intelligence (pp. 538-549).
>>>>> Springer Berlin Heidelberg.
>>>>>
>>>>> I suppose you could also evaluate the individual association rules on a
>>>>> separate test set, by computing the confidence measure, etc., on the
>>>>> test
>>>>> set for each rule, but this functionality is not provided by WEKA.
>>>>>
>>>>> Cheers,
>>>>> Eibe
>>>>>
>>>>>> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>>>>>>
>>>>>> Dear Sir/Madam
>>>>>>
>>>>>> I have discovered some rules through weka. Could you tell me how to
>>>>> measure  the accuracy of those rules.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann
>>>>>> <[hidden email]>
>>>>> wrote:
>>>>>>> The size of the final Apriori model as a serialised Java object can
>>>>>>> be
>>>>> established saving it to a file and considering the file size. Note that
>>>>> this is different from the size of the object in memory (see, e.g.,
>>>>> http://stackoverflow.com/questions/7146559/serialized-
>>>>> object-size-vs-in-memory-object-size-in-java#7146941).
>>>>>>>
>>>>>>> I don’t know of a good way to measure peak memory consumption of a
>>>>> Java program (after garbage collection). A crude way would be to run the
>>>>> program from the command-line (to avoid overhead associated with the
>>>>> GUIs)
>>>>> with different maximum heap sizes, e.g., increasing the heap size until
>>>>> the
>>>>> program runs through. Another option is to look at the heap size in a
>>>>> profiler (e.g., visualvm), enforcing garbage collection before a
>>>>> readout.
>>>>>>
>>>>>> You can use the sizeofag javaagent for determining the size of a Java
>>>>> object:
>>>>>> https://github.com/fracpete/sizeofag
>>>>>>
>>>>>> Credits to Maxim Zakharenkov, who wrote the original code.
>>>>>>
>>>>>> Cheers, Peter
>>>>>> --
>>>>>> Peter Reutemann
>>>>>> Dept. of Computer Science
>>>>>> University of Waikato, NZ
>>>>>> +64 (7) 858-5174
>>>>>> http://www.cms.waikato.ac.nz/~fracpete/
>>>>>> http://www.data-mining.co.nz/
>>>>>> _______________________________________________
>>>>>> Wekalist mailing list
>>>>>> Send posts to: [hidden email]
>>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>>> mailman/listinfo/wekalist
>>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>>> ml/weka/mailinglist_etiquette.html
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Thanks & Regards
>>>>>> Bhupesh Rawat.
>>>>>> Ph.D Scholar
>>>>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>>>>>> Vidya Vihar,Rai Bareilly road(Lucknow)
>>>>>> Ph. No: +91-9897065948
>>>>>>
>>>>>> ............................................................
>>>>> ...............................................................
>>>>>> *A man is the best judge of himself and he has to pay the price for
>>>>>> what
>>>>> he
>>>>>> does.*
>>>>>> ............................................................
>>>>> ...............................................................
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Wekalist mailing list
>>>>>> Send posts to: [hidden email]
>>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>>> mailman/listinfo/wekalist
>>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>>> ml/weka/mailinglist_etiquette.html
>>>>>
>>>>> _______________________________________________
>>>>> Wekalist mailing list
>>>>> Send posts to: [hidden email]
>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>>> mailman/listinfo/wekalist
>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>>> ml/weka/mailinglist_etiquette.html
>>>>>
>>>>
>>>
>>>
>>> --
>>> Thanks & Regards
>>> Bhupesh Rawat.
>>> Ph.D Scholar
>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>>> Vidya Vihar,Rai Bareilly road(Lucknow)
>>> Ph. No: +91-9897065948
>>>
>>> ...........................................................................................................................
>>> *A man is the best judge of himself and he has to pay the price for what
>>> he
>>> does.*
>>> ...........................................................................................................................
>>> <students' data after
>>> preprocessin.xlsx>_______________________________________________
>>> Wekalist mailing list
>>> Send posts to: [hidden email]
>>> List info and subscription status:
>>> https://list.waikato.ac.nz/mailman/listinfo/wekalist
>>> List etiquette:
>>> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>> _______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status:
>> https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> List etiquette:
>> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Bhupesh Rawat
Sir,
When I use the KnowledgeFlow GUI the status shown by two of the components is interrupted(namely crossvalidationfoldmaker and J48) as shown in the attached file. How to fix it? 

On Mon, Feb 27, 2017 at 3:08 AM, Eibe Frank <[hidden email]> wrote:
In the Explorer, there is no way to turn off evaluation completely. You could use the command-line interface or the KnowledgeFlow GUI though.

Having said this, if you evaluate on the training set, the runtime overhead is quite small if you apply a rule learner.

Note also that the Explorer always outputs the classification model for the *full* dataset loaded into the Preprocess panel, regardless of which evaluation metric you choose, i.e., you will get the rule set for the full dataset regardless of the evaluation method you use.

Cheers,
Eibe

> On 26/02/2017, at 8:07 PM, Bhupesh Rawat <[hidden email]> wrote:
>
> Sir,
>
> How could i perform these two task seperately(applying classification
> rule learner and estimating classification accuracy). The accuracy is
> estimated each time i run the classifier on the dataset.
>
>
>
> On 2/24/17, Eibe Frank <[hidden email]> wrote:
>> No, not really. However, the dataset is quite small. You could just run a
>> classification rule learner such as JRip or PART on the data, treating each
>> of the attributes in turn as the class attribute. Then you can estimate
>> classification accuracy using cross-validation.
>>
>> You could also create combinations of attributes using the CartesionProduct
>> filter.
>>
>> Cheers,
>> Eibe
>>
>>> On 24/02/2017, at 3:11 AM, Bhupesh Rawat <[hidden email]> wrote:
>>>
>>> I have a small dataset which contains student enrolment data in
>>> various courses. If a student has selected a particular course it is
>>> indicated by ‘Y’ else ‘N’ is used. I have also attached a file for
>>> better understanding of the dataset. I am interested in knowing if it
>>> is possible to measure the accuracy of the association rules with this
>>> dataset by the proposed approach in your paper.
>>>
>>> On 2/23/17, Bhupesh Rawat <[hidden email]> wrote:
>>>> Thank you so much for the response!!
>>>> On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
>>>>
>>>>> You mean beyond confidence, lift, or one the other metrics that you can
>>>>> get in the output of each rule? This is a tough question. One way may be
>>>>> to
>>>>> use the association rule mining algorithm to build classification rules
>>>>> and
>>>>> then evaluate the accuracy of those classification rules. We had a paper
>>>>> on
>>>>> this quite a while back:
>>>>>
>>>>> Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification
>>>>> to evaluate the output of confidence-based association rule mining. In
>>>>> Australasian Joint Conference on Artificial Intelligence (pp. 538-549).
>>>>> Springer Berlin Heidelberg.
>>>>>
>>>>> I suppose you could also evaluate the individual association rules on a
>>>>> separate test set, by computing the confidence measure, etc., on the
>>>>> test
>>>>> set for each rule, but this functionality is not provided by WEKA.
>>>>>
>>>>> Cheers,
>>>>> Eibe
>>>>>
>>>>>> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
>>>>>>
>>>>>> Dear Sir/Madam
>>>>>>
>>>>>> I have discovered some rules through weka. Could you tell me how to
>>>>> measure  the accuracy of those rules.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann
>>>>>> <[hidden email]>
>>>>> wrote:
>>>>>>> The size of the final Apriori model as a serialised Java object can
>>>>>>> be
>>>>> established saving it to a file and considering the file size. Note that
>>>>> this is different from the size of the object in memory (see, e.g.,
>>>>> http://stackoverflow.com/questions/7146559/serialized-
>>>>> object-size-vs-in-memory-object-size-in-java#7146941).
>>>>>>>
>>>>>>> I don’t know of a good way to measure peak memory consumption of a
>>>>> Java program (after garbage collection). A crude way would be to run the
>>>>> program from the command-line (to avoid overhead associated with the
>>>>> GUIs)
>>>>> with different maximum heap sizes, e.g., increasing the heap size until
>>>>> the
>>>>> program runs through. Another option is to look at the heap size in a
>>>>> profiler (e.g., visualvm), enforcing garbage collection before a
>>>>> readout.
>>>>>>
>>>>>> You can use the sizeofag javaagent for determining the size of a Java
>>>>> object:
>>>>>> https://github.com/fracpete/sizeofag
>>>>>>
>>>>>> Credits to Maxim Zakharenkov, who wrote the original code.
>>>>>>
>>>>>> Cheers, Peter
>>>>>> --
>>>>>> Peter Reutemann
>>>>>> Dept. of Computer Science
>>>>>> University of Waikato, NZ
>>>>>> +64 (7) 858-5174
>>>>>> http://www.cms.waikato.ac.nz/~fracpete/
>>>>>> http://www.data-mining.co.nz/
>>>>>> _______________________________________________
>>>>>> Wekalist mailing list
>>>>>> Send posts to: [hidden email]
>>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>>> mailman/listinfo/wekalist
>>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>>> ml/weka/mailinglist_etiquette.html
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Thanks & Regards
>>>>>> Bhupesh Rawat.
>>>>>> Ph.D Scholar
>>>>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>>>>>> Vidya Vihar,Rai Bareilly road(Lucknow)
>>>>>> Ph. No: +91-9897065948
>>>>>>
>>>>>> ............................................................
>>>>> ...............................................................
>>>>>> *A man is the best judge of himself and he has to pay the price for
>>>>>> what
>>>>> he
>>>>>> does.*
>>>>>> ............................................................
>>>>> ...............................................................
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Wekalist mailing list
>>>>>> Send posts to: [hidden email]
>>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>>> mailman/listinfo/wekalist
>>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>>> ml/weka/mailinglist_etiquette.html
>>>>>
>>>>> _______________________________________________
>>>>> Wekalist mailing list
>>>>> Send posts to: [hidden email]
>>>>> List info and subscription status: https://list.waikato.ac.nz/
>>>>> mailman/listinfo/wekalist
>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
>>>>> ml/weka/mailinglist_etiquette.html
>>>>>
>>>>
>>>
>>>
>>> --
>>> Thanks & Regards
>>> Bhupesh Rawat.
>>> Ph.D Scholar
>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
>>> Vidya Vihar,Rai Bareilly road(Lucknow)
>>> Ph. No: +91-9897065948
>>>
>>> ...........................................................................................................................
>>> *A man is the best judge of himself and he has to pay the price for what
>>> he
>>> does.*
>>> ...........................................................................................................................
>>> <students' data after
>>> preprocessin.xlsx>_______________________________________________
>>> Wekalist mailing list
>>> Send posts to: [hidden email]
>>> List info and subscription status:
>>> https://list.waikato.ac.nz/mailman/listinfo/wekalist
>>> List etiquette:
>>> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>> _______________________________________________
>> Wekalist mailing list
>> Send posts to: [hidden email]
>> List info and subscription status:
>> https://list.waikato.ac.nz/mailman/listinfo/wekalist
>> List etiquette:
>> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html



--
Thanks & Regards
Bhupesh Rawat.
Ph.D Scholar
Department of Computer Science,Babasaheb Bhimrao Ambedkar University
Vidya Vihar,Rai Bareilly road(Lucknow)
Ph. No: +91-9897065948

...........................................................................................................................
*A man is the best judge of himself and he has to pay the price for what he
does.*
...........................................................................................................................




_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

knowledge flow interuppted.docx (248K) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Measuring accuracy and efficiency of association rules!

Eibe Frank-2
Administrator
What does the log say (see the “log” tab next to the “status” tab)?

Cheers,
Eibe

> On 27/02/2017, at 11:56 PM, Bhupesh Rawat <[hidden email]> wrote:
>
> Sir,
> When I use the KnowledgeFlow GUI the status shown by two of the components is interrupted(namely crossvalidationfoldmaker and J48) as shown in the attached file. How to fix it?
>
> On Mon, Feb 27, 2017 at 3:08 AM, Eibe Frank <[hidden email]> wrote:
> In the Explorer, there is no way to turn off evaluation completely. You could use the command-line interface or the KnowledgeFlow GUI though.
>
> Having said this, if you evaluate on the training set, the runtime overhead is quite small if you apply a rule learner.
>
> Note also that the Explorer always outputs the classification model for the *full* dataset loaded into the Preprocess panel, regardless of which evaluation metric you choose, i.e., you will get the rule set for the full dataset regardless of the evaluation method you use.
>
> Cheers,
> Eibe
>
> > On 26/02/2017, at 8:07 PM, Bhupesh Rawat <[hidden email]> wrote:
> >
> > Sir,
> >
> > How could i perform these two task seperately(applying classification
> > rule learner and estimating classification accuracy). The accuracy is
> > estimated each time i run the classifier on the dataset.
> >
> >
> >
> > On 2/24/17, Eibe Frank <[hidden email]> wrote:
> >> No, not really. However, the dataset is quite small. You could just run a
> >> classification rule learner such as JRip or PART on the data, treating each
> >> of the attributes in turn as the class attribute. Then you can estimate
> >> classification accuracy using cross-validation.
> >>
> >> You could also create combinations of attributes using the CartesionProduct
> >> filter.
> >>
> >> Cheers,
> >> Eibe
> >>
> >>> On 24/02/2017, at 3:11 AM, Bhupesh Rawat <[hidden email]> wrote:
> >>>
> >>> I have a small dataset which contains student enrolment data in
> >>> various courses. If a student has selected a particular course it is
> >>> indicated by ‘Y’ else ‘N’ is used. I have also attached a file for
> >>> better understanding of the dataset. I am interested in knowing if it
> >>> is possible to measure the accuracy of the association rules with this
> >>> dataset by the proposed approach in your paper.
> >>>
> >>> On 2/23/17, Bhupesh Rawat <[hidden email]> wrote:
> >>>> Thank you so much for the response!!
> >>>> On Feb 23, 2017 8:26 AM, "Eibe Frank" <[hidden email]> wrote:
> >>>>
> >>>>> You mean beyond confidence, lift, or one the other metrics that you can
> >>>>> get in the output of each rule? This is a tough question. One way may be
> >>>>> to
> >>>>> use the association rule mining algorithm to build classification rules
> >>>>> and
> >>>>> then evaluate the accuracy of those classification rules. We had a paper
> >>>>> on
> >>>>> this quite a while back:
> >>>>>
> >>>>> Mutter, S., Hall, M., & Frank, E. (2004, December). Using classification
> >>>>> to evaluate the output of confidence-based association rule mining. In
> >>>>> Australasian Joint Conference on Artificial Intelligence (pp. 538-549).
> >>>>> Springer Berlin Heidelberg.
> >>>>>
> >>>>> I suppose you could also evaluate the individual association rules on a
> >>>>> separate test set, by computing the confidence measure, etc., on the
> >>>>> test
> >>>>> set for each rule, but this functionality is not provided by WEKA.
> >>>>>
> >>>>> Cheers,
> >>>>> Eibe
> >>>>>
> >>>>>> On 23/02/2017, at 12:46 AM, Bhupesh Rawat <[hidden email]> wrote:
> >>>>>>
> >>>>>> Dear Sir/Madam
> >>>>>>
> >>>>>> I have discovered some rules through weka. Could you tell me how to
> >>>>> measure  the accuracy of those rules.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On Tue, Feb 14, 2017 at 3:44 AM, Peter Reutemann
> >>>>>> <[hidden email]>
> >>>>> wrote:
> >>>>>>> The size of the final Apriori model as a serialised Java object can
> >>>>>>> be
> >>>>> established saving it to a file and considering the file size. Note that
> >>>>> this is different from the size of the object in memory (see, e.g.,
> >>>>> http://stackoverflow.com/questions/7146559/serialized-
> >>>>> object-size-vs-in-memory-object-size-in-java#7146941).
> >>>>>>>
> >>>>>>> I don’t know of a good way to measure peak memory consumption of a
> >>>>> Java program (after garbage collection). A crude way would be to run the
> >>>>> program from the command-line (to avoid overhead associated with the
> >>>>> GUIs)
> >>>>> with different maximum heap sizes, e.g., increasing the heap size until
> >>>>> the
> >>>>> program runs through. Another option is to look at the heap size in a
> >>>>> profiler (e.g., visualvm), enforcing garbage collection before a
> >>>>> readout.
> >>>>>>
> >>>>>> You can use the sizeofag javaagent for determining the size of a Java
> >>>>> object:
> >>>>>> https://github.com/fracpete/sizeofag
> >>>>>>
> >>>>>> Credits to Maxim Zakharenkov, who wrote the original code.
> >>>>>>
> >>>>>> Cheers, Peter
> >>>>>> --
> >>>>>> Peter Reutemann
> >>>>>> Dept. of Computer Science
> >>>>>> University of Waikato, NZ
> >>>>>> +64 (7) 858-5174
> >>>>>> http://www.cms.waikato.ac.nz/~fracpete/
> >>>>>> http://www.data-mining.co.nz/
> >>>>>> _______________________________________________
> >>>>>> Wekalist mailing list
> >>>>>> Send posts to: [hidden email]
> >>>>>> List info and subscription status: https://list.waikato.ac.nz/
> >>>>> mailman/listinfo/wekalist
> >>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
> >>>>> ml/weka/mailinglist_etiquette.html
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --
> >>>>>> Thanks & Regards
> >>>>>> Bhupesh Rawat.
> >>>>>> Ph.D Scholar
> >>>>>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> >>>>>> Vidya Vihar,Rai Bareilly road(Lucknow)
> >>>>>> Ph. No: +91-9897065948
> >>>>>>
> >>>>>> ............................................................
> >>>>> ...............................................................
> >>>>>> *A man is the best judge of himself and he has to pay the price for
> >>>>>> what
> >>>>> he
> >>>>>> does.*
> >>>>>> ............................................................
> >>>>> ...............................................................
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> _______________________________________________
> >>>>>> Wekalist mailing list
> >>>>>> Send posts to: [hidden email]
> >>>>>> List info and subscription status: https://list.waikato.ac.nz/
> >>>>> mailman/listinfo/wekalist
> >>>>>> List etiquette: http://www.cs.waikato.ac.nz/~
> >>>>> ml/weka/mailinglist_etiquette.html
> >>>>>
> >>>>> _______________________________________________
> >>>>> Wekalist mailing list
> >>>>> Send posts to: [hidden email]
> >>>>> List info and subscription status: https://list.waikato.ac.nz/
> >>>>> mailman/listinfo/wekalist
> >>>>> List etiquette: http://www.cs.waikato.ac.nz/~
> >>>>> ml/weka/mailinglist_etiquette.html
> >>>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> Thanks & Regards
> >>> Bhupesh Rawat.
> >>> Ph.D Scholar
> >>> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> >>> Vidya Vihar,Rai Bareilly road(Lucknow)
> >>> Ph. No: +91-9897065948
> >>>
> >>> ...........................................................................................................................
> >>> *A man is the best judge of himself and he has to pay the price for what
> >>> he
> >>> does.*
> >>> ...........................................................................................................................
> >>> <students' data after
> >>> preprocessin.xlsx>_______________________________________________
> >>> Wekalist mailing list
> >>> Send posts to: [hidden email]
> >>> List info and subscription status:
> >>> https://list.waikato.ac.nz/mailman/listinfo/wekalist
> >>> List etiquette:
> >>> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
> >>
> >> _______________________________________________
> >> Wekalist mailing list
> >> Send posts to: [hidden email]
> >> List info and subscription status:
> >> https://list.waikato.ac.nz/mailman/listinfo/wekalist
> >> List etiquette:
> >> http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
> >>
> >
> >
> > --
> > Thanks & Regards
> > Bhupesh Rawat.
> > Ph.D Scholar
> > Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> > Vidya Vihar,Rai Bareilly road(Lucknow)
> > Ph. No: +91-9897065948
> >
> > ...........................................................................................................................
> > *A man is the best judge of himself and he has to pay the price for what he
> > does.*
> > ...........................................................................................................................
> > _______________________________________________
> > Wekalist mailing list
> > Send posts to: [hidden email]
> > List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> > List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
> _______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
>
>
>
> --
> Thanks & Regards
> Bhupesh Rawat.
> Ph.D Scholar
> Department of Computer Science,Babasaheb Bhimrao Ambedkar University
> Vidya Vihar,Rai Bareilly road(Lucknow)
> Ph. No: +91-9897065948
>
> ...........................................................................................................................
> *A man is the best judge of himself and he has to pay the price for what he
> does.*
> ...........................................................................................................................
>
>
>
> <knowledge flow  interuppted.docx>_______________________________________________
> Wekalist mailing list
> Send posts to: [hidden email]
> List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
> List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

_______________________________________________
Wekalist mailing list
Send posts to: [hidden email]
List info and subscription status: https://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
Loading...