您的位置:首页 > 编程语言 > C#

C# remove duplicated word list

2014-01-10 14:00 162 查看
    

  List<string> wordsList = new List<string>();

  wordsList = File.ReadAllLines(inFilePath, Encoding.Unicode).ToList();

  wordsList = wordsList.GroupBy(x => x.ToLower()).Select(grp => grp.FirstOrDefault()).OrderBy(x => x).ToList();

  File.WriteAllLines(@"other.txt", wordsList, Encoding.Unicode);

  

  List<string> wordsList_ = new List<string>();
  wordsList_ = File.ReadAllLines(inFilePath, Encoding.Unicode).ToList();
  wordsList_ = wordsList_.Distinct(StringComparer.CurrentCultureIgnoreCase).OrderBy(x => x).ToList();

  File.WriteAllLines(outFilePath, wordsList_, Encoding.Unicode);

  List<string> wordsList = new List<string>();

  wordsList = File.ReadAllLines(inFilePath, Encoding.Unicode).ToList();  

  var result = wordsList.GroupBy(x => x.ToLower()).Select(grp => grp).OrderBy(x => x.Key);
  using (StreamWriter sw = new StreamWriter(outFilePath, false, Encoding.Unicode))
  {
    foreach (var item in result)
    {
      sw.WriteLine(item.FirstOrDefault() + '\t' + item.Count());
    }
  }
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: