特定のテキストファイルに対してjavaを使ってすべての改行とパラグラフを削除するにはどうすればよいですか？

Question

私は巨大なテキストファイルを持っています。 改行をすべて削除して、段落の改行を削除して前のparagrahに追加したいとします。 Javaを使ってどうすればいいですか？私はjavaでreplaceALL（）を使用していますが、私は前の段落に追加された段落を取得するつもりです。

Please view this image for the file screenshot

public void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException{ 
      StringBuilder sb = new StringBuilder(); 
      System.out.println(value.toString().replaceAll("[\\t\\n]+", "")); 
      StringTokenizer itr = new StringTokenizer(value.toString().replaceAll("[\\t\\n]+", ""));   
      String[] tokens = new String[itr.countTokens()*2]; 

      for(int l = 0 ; l<tokens.length;l++){ 
       if(itr.hasMoreTokens()){ 
        tokens[l] = itr.nextToken(); 

       } 
      } 
        for(int i = 0; i < tokens.length; i++){ 
        if(tokens[i] != null && tokens[i] != " "){ 
         sb.append(tokens[i]); 
          for(int j = i+1;j<i+5;j++){ 
           if(tokens[j] != null) 
           { 
           sb.append(" "); 
           sb.append(tokens[j]); 
           } 

          } 
        } 
         word.set(sb.toString()); 
         context.write(word, one); 
         //System.out.println(sb.toString()); 
         sb.setLength(0); 

        } 
     } 

入力：

The Project Gutenberg EBook of The Complete Works of William Shakespeare, by 
William Shakespeare 
sn 
This eBook is for the use of anyone anywhere at no cost and with 
almost no restrictions whatsoever. You may copy it, give it away or 
re-use it under the terms of the Project Gutenberg License included 
with this eBook or online at www.gutenberg.org 

** This is a COPYRIGHTED Project Gutenberg eBook, Details Below ** 
**  Please follow the copyright guidelines in this file.  ** 

Title: The Complete Works of William Shakespeare 

Author: William Shakespeare 

Posting Date: September 1, 2011 [EBook #100] 
Release Date: January, 1994 

Language: English 


*** START OF THIS PROJECT GUTENBERG EBOOK COMPLETE WORKS--WILLIAM SHAKESPEARE *** 




Produced by World Library, Inc., from their Library of the Future 

This is the 100th Etext file presented by Project Gutenberg, and 
is presented in cooperation with World Library, Inc., from their 
Library of the Future and Shakespeare CDROMS. Project Gutenberg 
often releases Etexts that are NOT placed in the Public Domain!! 

Shakespeare 

*This Etext has certain copyright implications you should read!* 

予想される出力：

The Project Gutenberg EBook of The Complete Works of William Shakespeare, by 
William Shakespeare sn This eBook is for the use of anyone anywhere at no cost and with almost no restrictions whatsoever. You may copy it, give it away or re-use it under the terms of the Project Gutenberg License included 
with this eBook or online at www.gutenberg.org ** This is a COPYRIGHTED Project Gutenberg eBook, Details Below Please follow the copyright guidelines in this file.Title: The Complete Works of William Shakespeare Author: William Shakespeare Posting Date: September 1, 2011 [EBook #100] 
Release Date: January, 1994 Language: English START OF THIS PROJECT GUTENBERG EBOOK COMPLETE WORKS--WILLIAM SHAKESPEARE Produced by World Library, Inc., from their Library of the Future This is the 100th Etext file presented by Project Gutenberg, and is presented in cooperation with World Library, Inc., from their Library of the Future and Shakespeare CDROMS. Project Gutenberg often releases Etexts that are NOT placed in the Public Domain!! Shakespeare *This Etext has certain copyright implications you should read!* 

Answer 1

あなただけの単語をしたい場合は、\ワットで単語を検索し、それらを連結することができます。

public static void main(String args[]) { 
    final String input = "hello, how are you today how was school today, what did you have for food? this star needs to be removed ****"; 
    final String regex = "\\w+"; 
    final Matcher m = Pattern.compile(regex).matcher(input); 

    String output = ""; 
    while (m.find()) { 
     output += m.group(0)+" "; 
    } 
    System.out.println(output); 
} 

結果：

hello how are you today how was school today what did you have for food this star needs to be removed 

Answer 2

使用文字列リテラルのエスケープ、本物のタブ、改行のために。また、キャリッジリターン（Windowsの場合）を忘れることはありません。

String text = value.toString() 
    .replaceAll("(\r?\n){2}", "§") // Two line breaks will become a real line break. 
    .replaceAll("[\t\r\n]+", " ") // White space will become a real space. 
    .replace("§", "\n"); // The real line breaks. 

代わりの§ 1いくつかの難解な文字uFEFFを使用する場合があります。

は、入力と出力期待の

Good Morning, 
How are you? I am fine.