-
Notifications
You must be signed in to change notification settings - Fork 8
add extractor: resiliparse trafilatura magic-html #3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
examples/magic_html_extract_demo.py
Outdated
| from magic_html import GeneralExtractor | ||
|
|
||
| # 初始化提取器 | ||
| extractor = GeneralExtractor() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这几个 example 是不是缺少了extractor 的初始化部分
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这边的示例主要还是演示新定义的extractor 的用法,不是原始安装包的抽取方法
| from typing import Dict, Any, Optional | ||
| from .base import BaseExtractor, ExtractionResult | ||
| from .factory import extractor | ||
| from magic_html import GeneralExtractor |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
我们整理一个 requirement.txt 文件吧,看起来要安装很多依赖
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
每一种 extractor tests 目录下也加一下单测用例
…ilatura magic-html
…ilatura magic-html
…ilatura magic-html
No description provided.