Python正则表达式的re库一些用法（上）

1、查找文本中的模式

search()函数取模式和要扫描的文本作为输入，找到这个模式时就返回一个match对象。如果没有找到模式，search()就返回None。

每个match对象包含有关匹配性质的信息，包含原输入字符串，所使用的正则表达式以及模式在原字符串出现的位置。

import re
pattern = 'this'
text = 'Does this text match the pattern?'
match = re.search(pattern, text)
s = match.start()
e = match.end()
print('Found "{}"\nin "{}"\nfrom {} to ("{}")'.format(match.re.pattern, match.string, s, e, text[s:e]))
_____________________输出___________________________________________
Found "this"
in "Does this text match the pattern?"
from 5 to ("9")

start()和end()方法可以提供字符串中的相应索引，指示与模式匹配的文本在字符串中出现的位置。

2、编译表达式

尽管re包括模块级函数，可以处理作为文本字符串的正则表达式，但是对于程序频繁使用的表达式而言，编译它们会更为高效。compile()函数会把一个表达式字符串转换为一个Regex0bject。

import re
regexes = [
    re.compile(p)
    for p in ['this', 'that']
]
text = 'Does this text match the pattern?'
print('Text: {!r}\n'.format(text))
for regex in regexes:
    print('Seeking "{}" ->'.format(regex.pattern),end=' ')
    if regex.search(text):
        print('match')
    else:
        print('no match')
_________________________输出_________________________________
Text: 'Does this text match the pattern?'
Seeking "this" -> match
Seeking "that" -> no match

模块级函数会维护一个包含已编译表达式的缓存，不过这个缓存的大小是有限的，另外直接使用已编译表达式可以避免与缓存查找相关的开销。使用已编译表达式的另一个好处为，通过在加载模块时预编译所有的表达式，可以把编译工作转移到应用开始时，而不是当程序响应一个用户动作时才编译。

3、多重匹配

使用search()来查找字面量文本字符串的单个实例，findall()函数会返回输入中与模式匹配而且不重叠的所有子串。

import re
text = 'abbaaabbbbaaaaaa'
pattern = 'ab'
for match in re.findall(pattern, text):
    print('Found {!r}'.format(match))
_______________________输出_____________________
Found 'ab'
Found 'ab'

finditer()返回一个迭代器，它会生成Match实例，而不是像findall()那样返回字符串。

import re
text = 'abbaaabbbbaaaaaa'
pattern = 'ab'
for match in re.finditer(pattern, text):
    s = match.start()
    e = match.end()
    print('Found {!r} at {:d}:{:d}'.format(text[s:e],s,e))
_______________________输出_______________________________
Found 'ab' at 0:2
Found 'ab' at 5:7

4、模式语法

正则表达式还支持更加强大的模式。模式可以重复，可以锚定到输入中不同的逻辑位置，可以用紧凑的形式表述而不需要在模式中提取每一个重复的字符

import re
def test_pattern(text,patterns):
    for pattern, desc in patterns:
        print("'{}' ({})\n".format(pattern,desc))
        print(" '{}'".format(text))
        for match in re.finditer(pattern, text):
            s = match.start()
            e = match.end()
            substr = text[s:e]
            n_backslashes = text[:s].count('\\')
            prefix = '.' * (s+n_backslashes)
            print(" {}'{}'".format(prefix,substr))
        print()
    return
if __name__ == "__main__":
    test_pattern('abbaaabbbbaaaaaa',[('ab',"'a' follow by 'b'"),])
________________________输出_______________________________________
'ab' ('a' follow by 'b')
 'abbaaabbbbaaaaaa'
 'ab'
 .....'ab'

输出显示输入文本以及输入中与模式匹配的各个部分的子串区间。

重复

模式中有5种表示重复的方法。模式后面如果有元字符*，则表示重复0次或多次（允许一个模式重复0次是指这个模式即使不出现也可以匹配）。如果把*替换为+，那么模式必须至少出现一次才能匹配。使用？表示模式出现0次或1次。如果要制定出现次数，需要在模式后面使用{m}，m表示模式应重复的次数。最后，如果要允许一个可变但有限的重复次数，那么可以使用{m,n}，这里m是最少重复次数，n是最大重复次数。如果省略n({m,}),则表示值必须至少出现m次，但没有最大限制。

test_pattern('abbaabbba',[('ab*','a followed by zero or more b'),
                          ('ab+','a followed by one or more b'),
                          ('ab?','a followed by zero or one b'),
                          ('ab{3}','a followed by three b'),
                          ('ab{2,3}','a followed by two or three b')],
)
__________________________输出__________________________________
'ab*' (a followed by zero or more b)
 'abbaabbba'
 'abb'
 ...'a'
 ....'abbb'
 ........'a'
'ab+' (a followed by one or more b)
 'abbaabbba'
 'abb'
 ....'abbb'
'ab?' (a followed by zero or one b)
 'abbaabbba'
 'ab'
 ...'a'
 ....'ab'
 ........'a'
'ab{3}' (a followed by three b)
 'abbaabbba'
 ....'abbb'
'ab{2,3}' (a followed by two or three b)
 'abbaabbba'
 'abb'
 ....'abbb'

处理重复指令时，re在匹配模式时通常会尽可能多地消费输入。这种像“贪心”的行为可能会导致单个匹配减少，或匹配结果包含比预想更多的输入文本。可以在重复指令后面加？来关闭贪心行为。

test_pattern('abbaabbba',[('ab*?','a followed by zero or more b'),
                          ('ab+?','a followed by one or more b'),
                          ('ab??','a followed by zero or one b'),
                          ('ab{3}?','a followed by three b'),
                          ('ab{2,3}?','a followed by two or three b')],
)
______________________________输出________________________________
'ab*?' (a followed by zero or more b)
 'abbaabbba'
 'a'
 ...'a'
 ....'a'
 ........'a'
'ab+?' (a followed by one or more b)
 'abbaabbba'
 'ab'
 ....'ab'
'ab??' (a followed by zero or one b)
 'abbaabbba'
 'a'
 ...'a'
 ....'a'
 ........'a'
'ab{3}?' (a followed by three b)
 'abbaabbba'
 ....'abbb'
'ab{2,3}?' (a followed by two or three b)
 'abbaabbba'
 'abb'
 ....'abb'

字符集

字符集是一组字符，包含可以与模式中当前位置匹配的所有字符。例如，[a,b]可以匹配为a或b

test_pattern('abbaabbba',[('[ab]','either a or b'),
                          ('a[ab]+','a followed by one or more a or b'),
                          ('a[ab]+?','a followed by one or more a or b, not greedy')],
)
________________________________输出__________________________________________
'[ab]' (either a or b)
 'abbaabbba'
 'a'
 .'b'
 ..'b'
 ...'a'
 ....'a'
 .....'b'
 ......'b'
 .......'b'
 ........'a'
'a[ab]+' (a followed by one or more a or b)
 'abbaabbba'
 'abbaabbba'
'a[ab]+?' (a followed by one or more a or b, not greedy)
 'abbaabbba'
 'ab'
 ...'aa'

尖字符（^）代表要查找不在这个尖字符后面的集合中的字符

test_pattern('This is some text -- with punctuation',[('[^-. ]+','sequences without -, ., or space')],)
__________________________________输出__________________________________
'[^-. ]+' (sequences without -, ., or space)
 'This is some text -- with punctuation'
 'This'
 .....'is'
 ........'some'
 .............'text'
 .....................'with'
 ..........................'punctuation'

利用字符区间来定义一个字符集

test_pattern('This is some text -- with punctuation',
            [('[a-z]+','sequences of lowercase letters'),
            ('[A-Z]+','sequences of uppercase letters'),
            ('[a-zA-Z]+','sequences of lower- or uppercase letters'),
            ('[a-z][A-Z]+','one uppercase followed by lowercase')],
)
————————————————————————————————————输出————————————————————————————————————
'[a-z]+' (sequences of lowercase letters)
 'This is some text -- with punctuation'
 .'his'
 .....'is'
 ........'some'
 .............'text'
 .....................'with'
 ..........................'punctuation'
'[A-Z]+' (sequences of uppercase letters)
 'This is some text -- with punctuation'
 'T'
'[a-zA-Z]+' (sequencesof lower- or uppercase letters)
 'This is some text -- with punctuation'
 'This'
 .....'is'
 ........'some'
 .............'text'
 .....................'with'
 ..........................'punctuation'
'[a-z][A-Z]+' (one uppercase followed by lowercase)
 'This is some text -- with punctuation'

元字符点号（.）指示模式应当匹配该位置的单个字符

test_pattern('This is some text -- with punctuation',
            [('a.','a followed by any one character'),
            ('b.','b follwed by any one character'),
            ('a.*b','a followed by anything ending in b'),
            ('a.*?b','a followed by anything, ending in b')],
)
____________________________输出_____________________________________
'a.' (a followed by any one character)
 'This is some text -- with punctuation'
 ................................'at'
'b.' (b follwed by any one character)
 'This is some text -- with punctuation'
'a.*b' (a followed by anything ending in b)
 'This is some text -- with punctuation'
'a.*?b' (a followed by anything, ending in b)
 'This is some text -- with punctuation'

转义码

转义码	含义
\d	数字
\D	非数字
\s	空白符（制表符、空格、换行等）
\S	非空白符
\w	字母数字
\W	非字母数字

test_pattern('A prime #1 example!',
            [(r'\d+','sequence of digits'),
            (r'\D+','sequence of non-digits'),
            (r'\s+','sequence of whitespqce'),
            (r'\S+','sequence of non-whitespqce'),
            (r'\w+','alphanumeric characters'),
            (r'\W+','non-alphanumeric'],
)
___________________________输出_______________________________
'\d+' (sequence of digits)
 'A prime #1 example!'
 .........'1'
'\D+' (sequence of non-digits)
 'A prime #1 example!'
 'A prime #'
 ..........' example!'
'\s+' (sequence of whitespqce)
 'A prime #1 example!'
 .' '
 .......' '
 ..........' '
'\S+' (sequence of non-whitespqce)
 'A prime #1 example!'
 'A'
 ..'prime'
 ........'#1'
 ...........'example!'
'\w+' (alphanumeric characters)
 'A prime #1 example!'
 'A'
 ..'prime'
 .........'1'
 ...........'example'
'\W+' (non-alphanumeric)
 'A prime #1 example!'
 .' '
 .......' #'
 ..........' '
 ..................'!'

要匹配正则表达式语法中包含的字符，需要转义搜索模式中的字符。

test_pattern(r'\d+ \D+ \s+',[(r'\\.\+','escape code')],)
________________________输出_____________________________
'\\.\+' (escape code)
 '\d+ \D+ \s+'
 '\d+'
 .....'\D+'
 ..........'\s+'

锚定

可以使用锚定指令指定模式在输入文本中的相对位置。

正则表达式锚定码

锚定码	含义
^	字符串或行开头
$	字符串或行末尾
\A	字符串开头
\Z	字符串末尾
\b	单词开头或末尾的空串
\B	不在的单词开头或末尾的空串

test_pattern('This is some text -- with punctuation',
            [(r'^\w+','word at start of string'),
            (r'\A\w+','word at start of string'),
            (r'\w+\S*$','word near end of string'),
            (r'\w+\S*\Z','word near end of string'),
            (r'\bt\w+','t at end of word'),
            (r'\Bt\B','not start or end of word')],
)
_____________________________输出__________________________________
'^\w+' (word at start of string)
 'This is some text -- with punctuation'
 'This'
'\A\w+' (word at start of string)
 'This is some text -- with punctuation'
 'This'
'\w+\S*$' (word near end of string)
 'This is some text -- with punctuation'
 ..........................'punctuation'
'\w+\S*\Z' (word near end of string)
 'This is some text -- with punctuation'
 ..........................'punctuation'
'\bt\w+' (t at end of word)
 'This is some text -- with punctuation'
 .............'text'
'\Bt\B' (not start or end of word)
 'This is some text -- with punctuation'
 .......................'t'
 ..............................'t'
 .................................'t'