通过函数findall获得唯一字符串

Question

我需要从文件(*.txt)中提取唯一的字符串。但是我的代码写了，所以同一行重复。我需要得到每一个唯一的字符串发出一次。？？

import re
f=open('C:\\isg-2000.txt')

p=f.readlines()
print len(p)
for i in range(len(p)):
  S = re.findall(r'set vrouter \".+?\"',p[i])
  if S:

    print S

这类产出：

4438
['set vrouter "untrust-vr"']
['set vrouter "trust-vr"']
['set vrouter "UntrustGi-vr"']
['set vrouter "TrustGi-vr"']
['set vrouter "CNDT-vr"']
['set vrouter "MGT"']
['set vrouter "MGT"']
['set vrouter "MGT"']
['set vrouter "untrust-vr"']
['set vrouter "trust-vr"']
['set vrouter "UntrustGi-vr"']
['set vrouter "TrustGi-vr"']
['set vrouter "CNDT-vr"']
['set vrouter "MGT"']
['set vrouter "untrust-vr"']
['set vrouter "trust-vr"']
['set vrouter "UntrustGi-vr"']
['set vrouter "TrustGi-vr"']
['set vrouter "CNDT-vr"']
['set vrouter "MGT"']

Answer 1

将set与生成器表达式一起使用：

import re
with open('C:\\isg-2000.txt') as f:
   r = re.compile(r'set vrouter \".+?\"')
   unique_matches = set(m for line in f for m in r.findall(line))

注意，如果顺序重要，则设置不保留顺序，请使用collections.OrderedDict

from collections import OrderedDict
...
unique_matches = list(OrderedDict.fromkeys(m for line in f for m in r.findall(line)))

Answer 2

请试试这个：

import re
f=open('C:\\Users\\vlazarev\\Desktop\\isg-2000-1-2013-08-14_for_amt.txt')

s = set(re.findall(r'set vrouter \".+?\"', f.read()))
print s