Interface Fragmenter

    • Method Detail

      • start

        void start(String originalText,
                   TokenStream tokenStream)
        Initializes the Fragmenter. You can grab references to the Attributes you are interested in from tokenStream and then access the values in isNewFragment().
        originalText - the original source text
        tokenStream - the TokenStream to be fragmented
      • isNewFragment

        boolean isNewFragment()
        Test to see if this token from the stream should be held in a new TextFragment. Every time this is called, the TokenStream passed to start(String, TokenStream) will have been incremented.