{"id":275,"date":"2017-12-07T08:58:38","date_gmt":"2017-12-07T10:58:38","guid":{"rendered":"http:\/\/web.inf.ufpr.br\/vri\/?page_id=275"},"modified":"2018-04-05T17:22:15","modified_gmt":"2018-04-05T20:22:15","slug":"dynse","status":"publish","type":"page","link":"https:\/\/web.inf.ufpr.br\/vri\/software\/dynse\/","title":{"rendered":"Dynse – Dynamic Selection Based Drift Handler"},"content":{"rendered":"

What is the Dynse?<\/h3>\n

The Dynse (Dynamic Selection Based Drift Handler) is a Framework developed to deal with Concept Drift Problems by means of the Dynamic Classifiers Selection.<\/p>\n

The Framework was built in Java using the MOA<\/a> and Weka<\/a> Frameworks.<\/p>\n

Dataset<\/h3>\n

We propose the PKLot dataset as concept drift benchmark. The protocol is described here<\/a>.<\/p>\n

License<\/h3>\n

The Dynse Framework is an open source project issued under the GNU General Public License 3<\/a>.<\/p>\n

You will Need<\/h3>\n
    \n
  1. Java 1.8<\/a><\/li>\n
  2. Eclipse Neon IDE<\/a> – Alternatively you may build using Apache Maven<\/li>\n
  3. Apache Maven<\/a> – Necessary even if you are using Eclipse<\/li>\n<\/ol>\n

    Get the Project from the repository<\/h3>\n

    The Project is hosted on the GitHub platform. You may download the project following one of the next three options:<\/p>\n

    Clone using a SSH-Key: <\/b>git clone git@github.com:paulorla\/dynse.git<\/i><\/p>\n

    Anonymous Clone: <\/b>git clone https:\/\/github.com\/paulorla\/dynse.git<\/i><\/p>\n

    Download Zip:<\/b> dynse.zip<\/i><\/a><\/p>\n

    Import the Project into Eclipse<\/h3>\n
      \n
    1. Clone the dynse into a directory of your choice. See how to get the framework from the repository<\/a><\/li>\n
    2. A dynse<\/i> directory will be created<\/li>\n
    3. Open the Eclipse passing the dynse<\/i> directory (the one that has the folders dynse<\/i> and RemoteSystemsTempFiles<\/i> in it) as the path for the Workspace. If you can’t change your Workspace check the FAQ<\/a>.<\/li>\n
    4. Go to File -> Import -> Existing Projects Into Workspace<\/i><\/li>\n
    5. In Select Root Directory<\/i>, select Browse<\/i>, and then click in OK<\/i> (the root directory is the same you used to create the workspace)<\/li>\n
    6. In Projects<\/i> the dynse<\/i> Project will appear marked.<\/li>\n
    7. Click in Finish<\/i>. It may take a while to Eclipse import the project and automatically download the project dependencies (through the Apache Maven)<\/li>\n
    8. Add the SizeOfFag<\/a> path in the Run Configuration.<\/li>\n<\/ol>\n

      Build Using Apache Maven (Optional)<\/h3>\n
        \n
      1. Open a terminal in the dynse<\/i> directory (the directory that has the pom.xml file)<\/li>\n
      2. Execute the command: mvn install<\/i><\/li>\n
      3. The built jar will be generated in the target<\/i> directory<\/li>\n<\/ol>\n

        SizeOfFag<\/h3>\n

        The sizeofag-1.0.0.jar<\/i> can be found here<\/b><\/a><\/p>\n

        Eclipse<\/b><\/p>\n

        Right click on your project on Eclipse -> Run As -> Run Configurations…<\/i><\/p>\n

        Go to the Arguments<\/i> Tab<\/p>\n

        In the VM Arguments<\/i> box, insert<\/p>\n

        -javaagent:[PATH_TO_SIZE_OF_FAG]\/sizeofag-1.0.0.jar<\/i><\/p>\n

        Example<\/p>\n

        -javaagent:\/home\/user\/.m2\/repository\/com\/googlecode\/sizeofag\/sizeofag\/1.0.0\/sizeofag-1.0.0.jar<\/p>\n

        Command Line<\/b><\/p>\n

        If you are running the project from the command line (e.g. you built the project using the Apache maven), just execute the generated jar as follows:<\/p>\n

        java -javaagent:[PATH_TO_SIZE_OF_FAG]\/sizeofag-1.0.0.jar -jar [DYNSE_JAR].jar<\/p>\n

        Example<\/p>\n

        java -javaagent:\/home\/user\/.m2\/repository\/com\/googlecode\/sizeofag\/sizeofag\/1.0.0\/sizeofag-1.0.0.jar -jar dynse.jar<\/p>\n

        Datasets<\/h3>\n

        Nebraska-Norm<\/b><\/a> – The normalized version of the Nebraska Weather Dataset (the original version can be found here<\/a>).<\/p>\n

        Checkerboard<\/b><\/a> – The arff converted files from the checkerboard datasets (the original version can be found here<\/a>).<\/p>\n

        Gaussian<\/b><\/a> – The arff converted files from the checkerboard datasets (the original version can be found here<\/a>).<\/p>\n

        Forest Covertype<\/b><\/a> – The normalized arff of the Forest Covertype dataset (note: this dataset is hosted in the MOA repository).<\/p>\n

        Digit-Norm<\/b><\/a> – The normalized version of the Digit Dataset (the original version can be found here<\/a>).<\/p>\n

        Digit<\/b><\/a> – The non-normalized version of the Digit Dataset (in this version the data were just put in the arff format).<\/p>\n

        Letters-Norm<\/b><\/a> – The normalized version of the Letters Dataset (the original version can be found here<\/a>).<\/p>\n

        Letters<\/b><\/a> – The non-normalized version of the Letters Dataset (in this version the data were just put in the arff format).<\/p>\n

        Create a Dynse using the Default Factory<\/h3>\n

        The project contains a default factory to build a ready to use Dynse Configuration. To use the factory follow the example:<\/p>\n

        \n
        \n\n\n\n
        \n
        \n
        AbstractDynseFactory realConceptDriftFactory = <\/code>new<\/code> RealConceptDriftDynseFactory();<\/code><\/span><\/div>\n
        StreamDynse dynse = dynseFactory.createDefaultDynseKE(<\/code>100<\/code>);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        The above example will create a configuration of the Dynse framework prepared for a Real Concept Drift, using a Knora-Eliminate as the Classification Engine, where each classifier is trained for every 100 supervised instances received. To create a configuration for virtual concept drifts, follow the example:<\/p>\n

        \n
        \n\n\n\n
        \n
        \n
        AbstractDynseFactory virtualConceptDriftFactory = <\/code>new<\/code> VirtualConceptDriftDynseFactory();<\/code><\/span><\/div>\n
        StreamDynse dynse = dynseFactory.createDefaultDynseKE(<\/code>100<\/code>);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        In both scenarios, the created dynse<\/i> object can be used as any MOA classifier.<\/p>\n

        The factories are prepared to build a dynse configuration using any of the implemented Classification Engines (OLA, KNORA-E, A Priori, etc.).<\/p>\n

        The default configuration is:<\/p>\n

        Nearest Neighbors: 9 for the KNORA-E (and a slack =2), and 5 for the other classification engines.<\/p>\n

        Accuracy Estimation Window Size: 4 x the number of train instances<\/i> for real concept drifts, and 32 x the number of train instances<\/i> for virtual concept drifts.<\/p>\n

        Base Classifier: The pool of classifiers is built using Naive Bayes classifiers.<\/p>\n

        Pruning: Only the latest 25 classifiers are kept in the pool.<\/p>\n

        Using the Testbeds<\/h3>\n

        The project include a serie of Testbeds using different datsets as examples<\/b>.<\/p>\n

        The testbeds are available in the package br.ufpr.dynse.testbed<\/p>\n

        You will need to manually select the test you want in the method executeTests<\/i> of your testbed, and you may need to download the necessary dataset and set the path to it when the dataset is not artificially generated by the moa (e.g. the Digit testbed)<\/p>\n

        Creating a custom configuration<\/h3>\n

        If you do not want to use a default configuration, you can create your own custom configuration of the Dynse framework.<\/p>\n

        First of all, you will need to define the pruning engine. The original Dynse framework comes with 3 distinct implementations in the package br.ufpr.dynse.pruningengine<\/i>: AgeBasedPruningEngine<\/i> (Remove the oldest classifier), AccuracyBasedPruningEngine<\/i> (Remove the worst performing classifier according to the current Accuracy Validation Window), and NoPrunePruningEngine<\/i> (keep all classifiers in the pool). If you want to implement your own pruning engine check the Section Creating your own Pruning Engine<\/a><\/p>\n

        It is also necessary to define a classifiers factory, which is responsible to build the base classifiers that will be added to the pool. In the package br.ufpr.dynse.classifier.factory<\/i> you can find a factory for Naive Bayes classifiers (NaiveBayesFactory<\/i>) and to HoeffdingTree classifiers (HoeffdingTreeFactory<\/i>). Check the Section Creating a Base Classifier Factory<\/a> to verify how to build your own base classifier factory.<\/p>\n

        The next step is to instantiate a Classification Engine. The Dynse framework already has many classification engines implemented. Just choose one in the package br.ufpr.dynse.classificationengine<\/i>. When instantiating a classification engine, you will also need to specify the number of neighbors considered to estimate the classifiers competence in the current accuracy estimation window. To create your own classification engine check the Section Creating your own Classification Engine<\/a>.<\/p>\n

        Finally, you will need to instantiate a StreamDynse<\/i> (our implementation of the Dynse Framework) passing the required information to the constructor, including the number of samples used to train each classifier, and the size of the accuracy estimation window in batches (note: the instances accumulated before creating a new classifier are considered a batch in our implementation).<\/p>\n

        See a complete example bellow:<\/p>\n

        \n
        \n\n\n\n
        \n
        \n
        import<\/span><\/code> br.ufpr.dynse.classificationengine.IClassificationEngine;<\/code><\/span><\/div>\n
        import<\/code> br.ufpr.dynse.classificationengine.KnoraEliminateClassificationEngine;<\/code><\/span><\/div>\n
        import<\/code> br.ufpr.dynse.classifier.competence.IMultipleClassifiersCompetence;<\/code><\/span><\/div>\n
        import<\/code> br.ufpr.dynse.core.StreamDynse;<\/code><\/span><\/div>\n
        import<\/code> br.ufpr.dynse.pruningengine.AgeBasedPruningEngine;<\/code><\/span><\/div>\n
        import<\/code> br.ufpr.dynse.pruningengine.DynseClassifierPruningMetrics;<\/code><\/span><\/div>\n
        import<\/code> br.ufpr.dynse.pruningengine.IPruningEngine;<\/code><\/span><\/div>\n
        \u00a0<\/span><\/div>\n
        private<\/code> static<\/code> final<\/code> int<\/code> POOL_SIZE = <\/code>50<\/code>;<\/code><\/span><\/div>\n
        private<\/code> static<\/code> final<\/code> int<\/code> TRAIN_SIZE = <\/code>200<\/code>;<\/code><\/span><\/div>\n
        private<\/code> static<\/code> final<\/code> int<\/code> ACC_WINDOW_SIZE = <\/code>2<\/code>;<\/code><\/span><\/div>\n
        \u00a0<\/span><\/div>\n
        \/\/...<\/code><\/span><\/div>\n
        \u00a0<\/span><\/div>\n
        public<\/code> void<\/code> myTestMethod(){<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>\/\/AgeBasedPruningEngine - remove the oldest classifiers<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>IPruningEngine<DynseClassifierPruningMetrics > prungingEngine = <\/code>new<\/code> AgeBasedPruningEngine(POOL_SIZE);<\/code>\/\/pool size set to 50<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>AbstractClassifierFactory classifierFactory = <\/code>new<\/code> NaiveBayesFactory();<\/code>\/\/naive bayes as the base learners<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>IClassificationEngine <IMultipleClassifiersCompetence> classificationEngine = <\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>new<\/code> KnoraEliminateClassificationEngine(<\/code>7<\/code>, <\/code>1<\/code>);<\/code>\/\/K-E as the classification engine, 7 neighbors and slack variable = 1<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>StreamDynse dynse = <\/code>new<\/code> StreamDynse(classifierFactory,<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>TRAIN_SIZE, ACC_WINDOW_SIZE, classificationEngine, prungingEngine);<\/code>\/\/train a new classifier for every 200 supervised samples<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>\/\/accuracy estimation window size set to 2 (i.e., 2x200 = 400 latest samples considered)<\/code><\/span><\/div>\n
        \u00a0<\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>\/\/...<\/code><\/span><\/div>\n
        }<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        The instantiated StreamDynse<\/i> can be used as any MOA classifier.<\/p>\n

        Extending the Framework<\/h3>\n

        Yoy may extend the Dynse framework and create your own classification engines, pruning engines, base classifiers factories, etc..<\/p>\n

        All you will need is to extend some classes and implement some interfaces, as explained in the next sections<\/p>\n

        Create a fork in the Git project, and share with us and other scientists your implementation! \u00a0 =)<\/b><\/p>\n

        Creating your own Pruning Engine<\/h4>\n

        In order to implement your own pruning engine, you will need to implement the IPruningEngine<\/i> interface.<\/p>\n

        \n
        \n\n\n\n
        \n
        \n
        public<\/code> interface<\/code> IPruningEngine<T <\/code>extends<\/code> DynseClassifierPruningMetrics> {<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>\/\/returns the classifiers that must be removed from the pool<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> List<DynseClassifier<T>> pruneClassifiers(DynseClassifier<T> newClassifier, List<DynseClassifier<T>> currentPool,<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>List<Instance> accuracyEstimationInstances) <\/code>throws<\/code> Exception;<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> meassureClassifier(DynseClassifier<T> classifier) <\/code>throws<\/code> Exception;<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> getPrunningEngineDescription(StringBuilder out);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> getPrunningEngineShortDescription(StringBuilder out);<\/code><\/span><\/div>\n
        }<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        Your class must implement the IPruningEngine<\/i> passing a template that extends DynseClassifierPruningMetrics<\/i>, or the class DynseClassifierPruningMetrics<\/i> itself. This class is necessary to define the metrics used in your pruning process (e.g., the classifier’s age).<\/p>\n

        The pruneclassifiers<\/i> method take the newest created classifier, the current pool of classifiers and the current accuracy estimation window. The method must return a list containing the classifiers that must be pruned<\/b> (this list can be empty). This method should not<\/b> alter the current pool.<\/p>\n

        The meassureClassifier<\/i> takes a classifier (often it will be the newest classifier created by the Dynse) and measures it acccording to the DynseClassifierPruningMetrics<\/i> (e.g., populate the creation time of the classifier).<\/p>\n

        The getPrunningEngineDescription<\/i> just write a desription of the pruning engine in out<\/i>.<\/p>\n

        The getPrunningEngineShortDescription<\/i> just write a short desription of the pruning engine in out<\/i>.<\/p>\n

        To see implementation examples, check the classes AgeBasedPruningEngine<\/i> and AccuracyBasedPruningEngine<\/i> available in the Dynse framework.<\/p>\n

        Note that it may be necessary to extend AbstractDynse<\/i> in order to generate a Dynse version compatible with your pruning metrics if you are not using the original DynseClassifierPruningMetrics<\/i>, or you may use some castings, which may be unsafe. This is necessary since the StreamDynse<\/i> was implemented to deal only with DynseClassifierPruningMetrics<\/i> due to the type erasure problem<\/b><\/a> in Java.<\/p>\n

        Creating a Base Classifier Factory<\/h4>\n

        You may use any base classifier in the Dynse Framework (e.g., SVM, Naive Bayes, KNN, etc.).<\/p>\n

        For now, we have a Naive Bayes<\/i> (NaiveBayesFactory<\/i>) and HoeffdingTree<\/i> (HoeffdingTreeFactory<\/i>) farctories implemented. If you want a factory for a different base classifier, just extend the AbstractClassifierFactory<\/i> class. See next an example of the implementation of this class used in the NaiveBayesFactory<\/i>:<\/p>\n

        \n
        \n\n\n\n
        \n
        \n
        public<\/code> class<\/code> NaiveBayesFactory <\/code>extends<\/code> AbstractClassifierFactory {<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>private<\/code> static<\/code> final<\/code> long<\/code> serialVersionUID = <\/code>1L<\/code>;<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>@Override<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> Classifier createClassifier() <\/code>throws<\/code> Exception {<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>NaiveBayes classifier = <\/code>new<\/code> NaiveBayes();<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>classifier.prepareForUse();<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>return<\/code> classifier;<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>}<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>@Override<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> getDescription(StringBuilder out) {<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>out.append(<\/code>\"Naive Bayes Factory\"<\/code>);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>}<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>@Override<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> getShortDescription(StringBuilder out) {<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>out.append(<\/code>\"NB\"<\/code>);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>}<\/code><\/span><\/div>\n
        }<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        The most important overriden method is the createClassifier<\/i>, which must create and prepareForUse<\/i> a base classifier (note that this method does not train the classifier).<\/p>\n

        The methods getDescription<\/i> and getShortDescription<\/i> just append a full and a short description description of the factory, respectivelly.<\/p>\n

        Creating your own Classification Engine<\/h4>\n

        You may find several classification engines pre-implemented in the package br.ufpr.dynse.classificationengine<\/i> (OLA, KNORA-E, A Priori, etc.).<\/p>\n

        If you want to implement your own classification engine, you must implement the interface IClassificationEngine<\/i> follow described:<\/p>\n

        \n
        \n\n\n\n
        \n
        \n
        public<\/span><\/code> interface<\/code> IClassificationEngine<U <\/code>extends<\/code> IMultipleClassifiersCompetence> <\/code>extends<\/code> Serializable{<\/code><\/span><\/div>\n
        \u00a0<\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> double<\/code>[] classify(Instance instance, List<DynseClassifier<DynseClassifierPruningMetrics>> availableClassifiers,<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code>Map<Instance, U> competenceMappings, NearestNeighbourSearch nnSearch) <\/code>throws<\/code> Exception;<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> NearestNeighbourSearch createNeighborSearchMethod();<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> boolean<\/code> getMapOnlyCorrectClassifiers();<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> List<DynseClassifier<DynseClassifierPruningMetrics>> getClassifiersUsedInLastClassification();<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> getClassificationEngineDescription(StringBuilder out);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> getClassificationEngineShortDescription(StringBuilder out);<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0<\/code>public<\/code> void<\/code> reset();<\/code><\/span><\/div>\n
        }<\/code><\/span><\/div>\n
        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/span><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        Your class must pass a template that extends the IMultipleClassifiersCompetence<\/i> interface, or the IMultipleClassifiersCompetence<\/i> itself.<\/p>\n

        The method classify<\/i> take the instance that must be classified, a list containing all available classifiers in the pool, a competence mapping of the classifiers’ competences and a nearest neighbors search object that can be used to find the k-nearest neighbors of the current instance. This method must return a double array representing the classification (i.e., the a posteriori<\/i> probabilities) of the instance.<\/p>\n

        The method createNeighborSearchMethod<\/i> must return a nearest neighbors search object. Usually it will be an instance of the moa.classifiers.lazy.neighboursearchLinearNNSearch<\/i> class.<\/p>\n

        The method getMapOnlyCorrectClassifiers must return true if only the classifiers that correctly classify the intances in the current accuracy estimation window should be mapped in the competence mapping (e.g.,a KNORA-E<\/i> based classificaiton engine), or return false if all classifiers should be mappped (e.g., a A Priori<\/i> based classification engine).<\/p>\n

        The method getClassifiersUsedInLastClassification<\/i> must return a list containing all classifiers used in the classification of the lastest test instance received.<\/p>\n

        The methods getClassificationEngineDescription<\/i> and getClassificationEngineShortDescription<\/i> just append a full and a short description description of the classification engine, respectivelly.<\/p>\n

        The method reset<\/i> resets the classification engine to its initial state.<\/p>\n

        FAQ<\/h3>\n
          \n
        1. Question: I cannot change the location of my workspace in EclipseAnswer: Check this<\/a> link.<\/li>\n
        2. Question: The results generated in the current framework implementation are slightly different from the PublicationsAnswer: In our publications we used an older version of the MOA Framework (2014-11) and classifiers from the Weka 3-7-13. In the current implementation we use the MOA 2016-04 and its classifiers, which may generate generate a small difference in the predictions.This difference is caused mainly (but not only) by the normalization of data, since the Weka classifiers and datasets used in previous experiments automatically normalized the information. If you normalize each batch before training\/testing the results come closer to the published ones.To overcome this, we define the Naive Bayes as the base learners in the default DynseFactory, since this base learner is less sensitive to the normalization of data. If you want to use Hoeffding Threes (or any other classifier as base learner), in the AbstractDynseFactory change the line:\n
          \n
          \n\n\n\n
          \n
          \n
          public<\/code> final<\/code> AbstractClassifierFactory classifierFactory = <\/code>new<\/code> NaiveBayesFactory();<\/code><\/span><\/div>\n
          \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

          To<\/b><\/p>\n

          \n
          \n\n\n\n
          \n
          \n
          public<\/code> final<\/code> AbstractClassifierFactory classifierFactory = <\/code>new<\/code> <\/span>HoeffdingTreeFactory();<\/span><\/code><\/div>\n
          \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n<\/li>\n
        3. Question: The Eclipse does not find the Main<\/i> classAnswer: Just open the Main<\/i> class in the Eclipse (package br.ufpr.dynse<\/i>) and then Run the Project<\/li>\n<\/ol>\n

          References<\/h3>\n