在 Java 中使用 JSOUP 库从 HTML 中读取内容
Posted
技术标签:
【中文标题】在 Java 中使用 JSOUP 库从 HTML 中读取内容【英文标题】：To read content from HTML using JSOUP Library in java 【发布时间】：2021-09-11 11:51:30 【问题描述】：我的 html 电子邮件正文如下所示。
我想获取 emailBody(Company,Priority,Description 等) 中存在的每个元素，最后制作 Json 键值对。
我希望通过使用JSOUP Library 我们能够实现这一目标。
HTML 内容：
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none">
<!--
p
margin-top:0;
margin-bottom:0
-->
</style>
</head>
<body dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<a>
<b>
<span lang="EN-US" style="font-size:10.0pt; font-family:"Segoe UI",sans-serif; color:black">Mandatory fields are Ticket Type, Company, Priority, Short Description. </span>
</b>
</a>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<span lang="EN-US" style=""> </span>
</b>
</span>
</p>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<span style=""></span>
<table class="MsoNormalTable" align="left" style="width:499.25pt; border-collapse:collapse; border:none; margin-left:6.75pt; margin-right:6.75pt; margin-bottom:5.75pt">
<tbody>
<tr style="height:19.85pt">
<td valign="top" style="width:112.25pt; border:solid windowtext 1.0pt; padding:0cm 5.4pt 0cm 5.4pt; height:19.85pt">
<p class="MsoNormal" align="right" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; text-align:right; line-height:105%">
<span style=""></span>
<span style="">
<b>
<span style="color:red">Ticket Type: </span>
</b>
</span>
<span style="">
<span style=""> </span>
</span>
</p>
</td>
<td valign="top" style="width:387.0pt; border:solid windowtext 1.0pt; border-left:none; padding:0cm 5.4pt 0cm 5.4pt; height:19.85pt">
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; line-height:105%">
<span style="">
<span style="">Incident </span>
</span>
</p>
</td>
</tr>
<tr style="height:17.35pt">
<td valign="top" style="width:112.25pt; border:solid windowtext 1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" align="right" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; text-align:right; line-height:105%">
<span style="">
<b>
<span style="">
<span style="color:red">Company:</span>
</span>
</b>
</span>
</p>
</td>
<td valign="top" style="width:387.0pt; border-top:none; border-left:none; border-bottom:solid windowtext 1.0pt; border-right:solid windowtext 1.0pt; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; line-height:105%">
<span style="">
<span style="">Grupo Bimbo DSDE </span>
</span>
</p>
</td>
</tr>
<tr style="height:17.35pt">
<td valign="top" style="width:112.25pt; border:solid windowtext 1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" align="right" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; text-align:right; line-height:105%">
<span style="">
<b>
<span style="">Configuration Item: </span>
</b>
</span>
</p>
</td>
<td valign="top" style="width:387.0pt; border-top:none; border-left:none; border-bottom:solid windowtext 1.0pt; border-right:solid windowtext 1.0pt; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<span style=""></span>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; line-height:105%">
<span style="">
<span style=""> </span>
</span>
</p>
</td>
</tr>
<tr style="height:17.35pt">
<td valign="top" style="width:112.25pt; border:solid windowtext 1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" align="right" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; text-align:right; line-height:105%">
<span style="">
<b>
<span style="color:red">Priority: </span>
</b>
</span>
</p>
</td>
<td valign="top" style="width:387.0pt; border-top:none; border-left:none; border-bottom:solid windowtext 1.0pt; border-right:solid windowtext 1.0pt; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; line-height:105%">
<span style="">
<span style="">P3-Moderate </span>
</span>
</p>
</td>
</tr>
<tr style="height:17.35pt">
<td valign="top" style="width:112.25pt; border:solid windowtext 1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" align="right" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; text-align:right; line-height:105%">
<span style="">
<b>
<span style="color:red">Short Description: </span>
</b>
</span>
</p>
</td>
<td valign="top" style="width:387.0pt; border-top:none; border-left:none; border-bottom:solid windowtext 1.0pt; border-right:solid windowtext 1.0pt; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<span style=""></span>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; line-height:105%">
<span style="">
<span style=""> </span>
</span>
</p>
</td>
</tr>
<tr style="height:17.35pt">
<td valign="top" style="width:112.25pt; border:solid windowtext 1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<p class="MsoNormal" align="right" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; text-align:right; line-height:105%">
<span style="">
<b>
<span style="">Description: </span>
</b>
</span>
</p>
</td>
<td valign="top" style="width:387.0pt; border-top:none; border-left:none; border-bottom:solid windowtext 1.0pt; border-right:solid windowtext 1.0pt; padding:0cm 5.4pt 0cm 5.4pt; height:17.35pt">
<span style=""></span>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif; line-height:105%">
<span style="">
<span style=""> </span>
</span>
</p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style=""></span>
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style=""> </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<u>
<span lang="EN-US" style="font-size:13.0pt">NOTE: Request user to contact CMS Operations Team at +91-7337894153/8939984385 for Critical Incidents - P1 with business impact. </span>
</u>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<b>
<span lang="EN-US" style=""> </span>
</b>
</span>
</p>
<p class="MsoNormal" style="margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">
<span style="">
<span lang="EN-US" style="font-size:10.5pt; color:black">Thanks,
<br>CMS Support
</span>
</span>
<span style="">
<b>
<span lang="EN-US" style=""> </span>
</b>
</span>
</p>
<br>
</div>
</body>
</html>
代码：
public class FetchHTMLBody
private static final Logger logger = Logger.getLogger(FetchHTMLBody.class.getName());
public static void main(String[] args)
String htmlContent="<html Content mentioned above>"
Document doc = Jsoup.parse(htmlContent);
List<String> keys = new ArrayList<>();
List<Map<String, String>> dataPairs = new ArrayList<>();
Elements trElements = doc.getElementsByTag("tr");
//logger.info("trElements::" + trElements);
for (int i = 0; i < trElements.size(); i++)
Element element = trElements.get(i);
Elements pElements = element.getElementsByTag("td");
//logger.info("pElements::" + pElements);
Map<String, String> map = new HashMap<>();
for (int i1 = 0; i1 < pElements.size(); i1++)
Element p = pElements.get(i1);
if (i == 0)
keys.add(p.text());
else
map.put(keys.get(i1), p.text());
dataPairs.add(map);
logger.info("trElements::" + dataPairs);
上面的代码给出了错误的输出，如下所示
[, Ticket Type: =Company: , Incident =Grupo Bimbo DSDE , Ticket Type: =Configuration Item: , Incident = , Ticket Type: =Priority: , Incident =P3-Moderate , Ticket Type: =Short Description: , Incident = , Ticket Type: =Description: , Incident = ]
预期输出如下：
Ticket Type=Incident,
Company=Grupo Bimbo DSDE,
Configuration Item=null,
Priority=P3-Moderate,
Short Description=null,
Description=null
谁能帮我解决这个问题？
【问题讨论】：
【参考方案1】： Document doc = Jsoup.parse(htmlContent);
List<String> keys = new ArrayList<>();
List<Map<String, String>> dataPairs = new ArrayList<>();
Elements trElements = doc.getElementsByTag("tr");
//logger.info("trElements::" + trElements);
for (Element trElement : trElements)
Elements tdElements = trElement.getElementsByTag("td");
//logger.info("pElements::" + pElements);
Map<String, String> map = new HashMap<>();
keys.add(tdElements.get(0).text());
map.put(tdElements.get(0).text(), tdElements.get(1).text());
dataPairs.add(map);
logger.info("trElements::" + dataPairs);
【讨论】：
嗨@Makoto Hata，我在映射中得到了一些unicode字符。我可以知道这是什么原因吗？ 【配置项：┬á=┬á，工单类型：┬á=事件┬á，描述：┬á=┬á，优先级：┬á=P3-中等┬á，简短描述：┬á=┬á，公司： ┬á=Grupo Bimbo DSDE┬á] 嗨@我已经删除了上面提到的字符，如下图 map.put(tdElements.get(0).text().replaceAll("[^\\pASCII]", "") , tdElements.get(1).text().replaceAll("[^\\pASCII]", ""));【参考方案2】：调试 Java 代码后，我找到了适合我的用例的解决方案。
解决方案代码：
Document doc = Jsoup.parse(htmlContent);
List<String> keys = new ArrayList<>();
List<Map<String, String>> dataPairs = new ArrayList<>();
Map<String, String> map = new HashMap<>();
Elements trElements = doc.getElementsByTag("tr");
//logger.info("trElements::" + trElements);
for (int i = 0; i < trElements.size(); i++)
Element element = trElements.get(i);
Elements pElements = element.getElementsByTag("td");
//logger.info("pElements::" + pElements);
for (int i1 = 0; i1 < pElements.size(); i1++)
Element p = pElements.get(i1);
if (i1 == 0)
keys.add(p.text());
else
map.put(keys.get(i), p.text());
logger.info("Map::" + map.entrySet());
输出：
[Configuration Item: = , Ticket Type: =Incident , Description: = , Priority: =P3-Moderate , Short Description: = , Company: =Grupo Bimbo DSDE ]
【讨论】：
以上是关于在 Java 中使用 JSOUP 库从 HTML 中读取内容的主要内容，如果未能解决你的问题，请参考以下文章
在 Java 中使用 Jsoup 将 HTML 表解析为 JSON
用jsoup解析HTML时报错；java.lang.noclassdeffounderror:org/jsoup/Jsoup