em.learn() Execution time in Jsmile
em.learn() Execution time in Jsmile
I have a BN with 12 input nodes and 1 output node. The em.learn() algorithm is taking 30 minutes. Is this execution time normal?
-
- Site Admin
- Posts: 1417
- Joined: Mon Nov 26, 2007 5:51 pm
Re: em.learn() Execution time in Jsmile
The execution time depends on the structure of your networks (large CPTs will slow down the learning), the file size (obviously the greater the row count, the longer the EM runtime) and the amount of missing data.
Can you compare the jSMILE and GeNIe runtimes for your network and datafile?
Can you compare the jSMILE and GeNIe runtimes for your network and datafile?
Re: em.learn() Execution time in Jsmile
Hi,
Thanks for answering,
I have a network with 17 input nodes (each one with 3 states) and 1 output node with 2 states (The CPT have more that 40,000,000 of columns :-() neither, jsmile or GENIE can calculate the probabilities, GENIE throw an "out of memory error".
Thanks
Oscar Hernán Franco Bedoya
Assistant Researcher
Department of Service and Information System Engineering (ESSI)
Universitat Politècnica de Catalunya (UPC)
Barcelona, Spain
Thanks for answering,
I have a network with 17 input nodes (each one with 3 states) and 1 output node with 2 states (The CPT have more that 40,000,000 of columns :-() neither, jsmile or GENIE can calculate the probabilities, GENIE throw an "out of memory error".
Thanks
Oscar Hernán Franco Bedoya
Assistant Researcher
Department of Service and Information System Engineering (ESSI)
Universitat Politècnica de Catalunya (UPC)
Barcelona, Spain
-
- Site Admin
- Posts: 1417
- Joined: Mon Nov 26, 2007 5:51 pm
Re: em.learn() Execution time in Jsmile
That's definitely a workload for 64-bit SMILE on a machine with tons of RAM.The CPT have more that 40,000,000 of column
-
- Site Admin
- Posts: 430
- Joined: Tue Dec 11, 2007 4:24 pm
Re: em.learn() Execution time in Jsmile
Brute force will not do here and your problem will be faced by any Bayesian network software. SMILE is one of the most efficient and fastest packages there are. Please note the the size of CPT grows exponentially with the number of parents and your CPT is indeed quite challenging :-). Try some techniques for structural changes to your network, such as "parent divorcing". They can reduce the size of your model drastically.
Marek
Marek
Re: em.learn() Execution time in Jsmile
Thanks a lot for your recommendation, I am going to try this approach.
Regards
Oscar
Regards
Oscar