Python模块pyquery应用技巧

举报
yk 坤帝 发表于 2022/03/23 01:20:08 2022/03/23
【摘要】 公众号 yk 坤帝 后台回复 pyquery 获取全部源代码 1. 初始化部分 1.1 字符串初始化 1.2 URL初始化 1.3 文件初始化 2. 基本CSS选择器 3. 查找元素 3.1 查找子元素 3.2 查找父元素 3.3 查找兄弟元素 4. 遍历单个元素 5. 获取属性,文本,HT...

公众号 yk 坤帝

后台回复 pyquery 获取全部源代码

1. 初始化部分

1.1 字符串初始化

1.2 URL初始化

1.3 文件初始化

2. 基本CSS选择器

3. 查找元素

3.1 查找子元素

3.2 查找父元素

3.3 查找兄弟元素

4. 遍历单个元素

5. 获取属性,文本,HTML

5.1 获取属性

5.2 获取文本

5.3 获取HTML

6. DOM操作

6.1 addClass、removeClass

6.2 attr、css

6.3 remove

7. 伪类选择器

1. 初始化部分

1.1 字符串初始化


  
  1. html = '''
  2. <div>
  3. <ul>
  4. <li class="item-0">first item</li>
  5. <li class="item-1"><a href="link2.html">second item</a></li>
  6. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  7. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  8. <li class="item-0"><a href="link5.html">fifth item</a></li>
  9. </ul>
  10. </div>
  11. '''
  12. from pyquery import PyQuery as pq
  13. doc = pq(html)
  14. print(doc('li'))

1.2 URL初始化


  
  1. from pyquery import PyQuery as pq
  2. doc = pq(url='http://www.baidu.com')
  3. print(doc('head'))

1.3 文件初始化


  
  1. from pyquery import PyQuery as pq
  2. doc = pq(filename='demo.html')
  3. print(doc('li'))

2. 基本CSS选择器


  
  1. html = '''
  2. <div id="container">
  3. <ul class="list">
  4. <li class="item-0">first item</li>
  5. <li class="item-1"><a href="link2.html">second item</a></li>
  6. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  7. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  8. <li class="item-0"><a href="link5.html">fifth item</a></li>
  9. </ul>
  10. </div>
  11. '''
  12. from pyquery import PyQuery as pq
  13. doc = pq(html)
  14. print(doc('#container .list li'))

3. 查找元素

3.1 查找子元素


  
  1. 公众号 yk 坤帝
  2. 后台回复 pyquery 获取全部源代码
  3. html = '''
  4. <div id="container">
  5. <ul class="list">
  6. <li class="item-0">first item</li>
  7. <li class="item-1"><a href="link2.html">second item</a></li>
  8. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  9. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  10. <li class="item-0"><a href="link5.html">fifth item</a></li>
  11. </ul>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. items = doc('.list')
  17. print(type(items))
  18. print(items)
  19. lis = items.find('li')
  20. print(type(lis))
  21. print(lis)

  
  1. lis = items.children()
  2. print(type(lis))
  3. print(lis)

3.2 查找父元素


  
  1. html = '''
  2. <div id="container">
  3. <ul class="list">
  4. <li class="item-0">first item</li>
  5. <li class="item-1"><a href="link2.html">second item</a></li>
  6. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  7. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  8. <li class="item-0"><a href="link5.html">fifth item</a></li>
  9. </ul>
  10. </div>
  11. '''
  12. from pyquery import PyQuery as pq
  13. doc = pq(html)
  14. items = doc('.list')
  15. container = items.parent()
  16. print(type(container))
  17. print(container)

  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. items = doc('.list')
  17. parents = items.parents()
  18. print(type(parents))
  19. print(parents)

  
  1. parent = items.parents('.wrap')
  2. print(parent)

3.3 查找兄弟元素


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('.list .item-0.active')
  17. print(li.siblings())

  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('.list .item-0.active')
  17. print(li.siblings('.active'))

4. 遍历单个元素


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('.item-0.active')
  17. print(li)

  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. lis = doc('li').items()
  17. print(type(lis))
  18. for li in lis:
  19. print(li)

5. 获取属性,文本,HTML

5.1 获取属性


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. a = doc('.item-0.active a')
  17. print(a)
  18. print(a.attr('href'))
  19. print(a.attr.href)

5.2 获取文本


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. a = doc('.item-0.active a')
  17. print(a)
  18. print(a.text())

5.3 获取HTML


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('.item-0.active')
  17. print(li)
  18. print(li.html())

6. DOM操作

6.1 addClass、removeClass


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('.item-0.active')
  17. print(li)
  18. li.removeClass('active')
  19. print(li)
  20. li.addClass('active')
  21. print(li)

6.2 attr、css


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('.item-0.active')
  17. print(li)
  18. li.attr('name', 'link')
  19. print(li)
  20. li.css('font-size', '14px')
  21. print(li)

6.3 remove


  
  1. html = '''
  2. <div class="wrap">
  3. Hello, World
  4. <p>This is a paragraph.</p>
  5. </div>
  6. '''
  7. from pyquery import PyQuery as pq
  8. doc = pq(html)
  9. wrap = doc('.wrap')
  10. print(wrap.text())
  11. wrap.find('p').remove()
  12. print(wrap.text())

7. 伪类选择器


  
  1. html = '''
  2. <div class="wrap">
  3. <div id="container">
  4. <ul class="list">
  5. <li class="item-0">first item</li>
  6. <li class="item-1"><a href="link2.html">second item</a></li>
  7. <li class="item-0 active"><a href="link3.html"><span class="bold">third item</span></a></li>
  8. <li class="item-1 active"><a href="link4.html">fourth item</a></li>
  9. <li class="item-0"><a href="link5.html">fifth item</a></li>
  10. </ul>
  11. </div>
  12. </div>
  13. '''
  14. from pyquery import PyQuery as pq
  15. doc = pq(html)
  16. li = doc('li:first-child')
  17. print(li)
  18. li = doc('li:last-child')
  19. print(li)
  20. li = doc('li:nth-child(2)')
  21. print(li)
  22. li = doc('li:gt(2)')
  23. print(li)
  24. li = doc('li:nth-child(2n)')
  25. print(li)
  26. li = doc('li:contains(second)')
  27. print(li)

公众号 yk 坤帝

后台回复 pyquery 获取全部源代码

文章来源: blog.csdn.net,作者:yk 坤帝,版权归原作者所有,如需转载,请联系作者。

原文链接:blog.csdn.net/qq_45803923/article/details/123672317

【版权声明】本文为华为云社区用户转载文章,如果您发现本社区中有涉嫌抄袭的内容,欢迎发送邮件进行举报,并提供相关证据,一经查实,本社区将立刻删除涉嫌侵权内容,举报邮箱: cloudbbs@huaweicloud.com
  • 点赞
  • 收藏
  • 关注作者

评论(0

0/1000
抱歉,系统识别当前为高风险访问,暂不支持该操作

全部回复

上滑加载中

设置昵称

在此一键设置昵称,即可参与社区互动!

*长度不超过10个汉字或20个英文字符,设置后3个月内不可修改。

*长度不超过10个汉字或20个英文字符,设置后3个月内不可修改。