如何使用 C# 获取检查元素代码
Posted
技术标签:
【中文标题】如何使用 C# 获取检查元素代码【英文标题】：how to get inspect element code using c# 【发布时间】：2014-03-27 03:07:18 【问题描述】：我想从 URL 获取文本，但源代码中没有显示文本。我只能在检查元素中看到它。无论如何，在 C# 中获取页面的 Inspect 元素的内容。我用 c# 尝试了 htmlagilitypack，但给出了 null 异常。
Class1 class1obj = new Class1();
HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
request.Method = "GET";
HttpWebResponse response = (HttpWebResponse)request.GetResponse();
if (response.StatusCode == HttpStatusCode.OK)
Stream receiveStream = response.GetResponseStream();
StreamReader readStream = null;
if (response.CharacterSet == null)
readStream = new StreamReader(receiveStream);
else
readStream = new StreamReader(receiveStream, Encoding.GetEncoding(response.CharacterSet));
class1obj.Data1 = readStream.ReadToEnd();
Console.WriteLine(class1obj.Data1);
readStream.Close();
HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument();
doc.LoadHtml(class1obj.Data1);
// HtmlNodeCollection tables2 = doc.DocumentNode.SelectNodes(".//div[@class='tv_ch_detila h_scroll_detail']");
HtmlNode rows2 = doc.DocumentNode.SelectSingleNode(".//div[@class='sub_text']");
Console.WriteLine(rows2.InnerText);
【问题讨论】：
可以分享网址吗？ 网址：whatsonindia.com/#!/Tv-Listings 好的，你要选择什么元素？ 类 class="channelProgrammeRow ng-scope odd" 内的节目安排，但该类仅在检查元素代码中不会出现在源代码中 好吧，我好像没有在这里找到“节目表”...你要抢“tv_guide_container”吗？你能给我一张你想提取的东西吗？ 【参考方案1】：这是一种在页面加载后动态加载的加密数据。获取上述数据的 Url 是：
http://www.whatsonindia.com/appi/user?channelgenre=all&context=applicationname%3Dsourcebits%3Bheadendid%3D0&dateselected=0&mode=getTVGuideInfo&pageno=1&responseformat=json&responselanguage=English&starthour=0&totalhrdata=24&userid=-1
它包含 JSON 格式的“数据”和“pki”节点。您不能只回复等待页面完全加载。
相反，您可以向给定的 url 发出请求并解密文本。这是我在这里可以假设的唯一方法。不可靠的方法是在 Web 浏览器控件中加载 url 并等待几秒钟（比如 5-10），假设所有内容都已加载，然后解析 DocumentText 或 Web 浏览器控件。
我设法为电视节目获取了这个 JSON 数据：
"gettvguidewithgenre":
"tvguideprogrammewithgenrelist": [
"programmeid": "10000000934920000",
"starttime": "2014-02-25T00:00:00+05:30",
"endtime": "2014-02-25T01:40:00+05:30",
"channelid": "10000000000110000",
"programmename": "Ghatak",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Action",
"Isrecommended": "1"
,
"programmeid": "30000000549824121",
"starttime": "2014-02-25T01:40:00+05:30",
"endtime": "2014-02-25T03:50:00+05:30",
"channelid": "10000000000110000",
"programmename": "Time Limit-36 Ghante",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Drama",
"Isrecommended": "1"
,
"programmeid": "30000000549816018",
"starttime": "2014-02-25T03:50:00+05:30",
"endtime": "2014-02-25T05:40:00+05:30",
"channelid": "10000000000110000",
"programmename": "Volcano High",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Action",
"Isrecommended": "1"
,
"programmeid": "30000000549673440",
"starttime": "2014-02-25T05:40:00+05:30",
"endtime": "2014-02-25T08:10:00+05:30",
"channelid": "10000000000110000",
"programmename": "Maa Beti",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Drama",
"Isrecommended": "1"
,
"programmeid": "10000001008740000",
"starttime": "2014-02-25T08:10:00+05:30",
"endtime": "2014-02-25T11:05:00+05:30",
"channelid": "10000000000110000",
"programmename": "Dus",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Action",
"Isrecommended": "1"
,
"programmeid": "30000000549644318",
"starttime": "2014-02-25T11:05:00+05:30",
"endtime": "2014-02-25T13:55:00+05:30",
"channelid": "10000000000110000",
"programmename": "Money Hai Toh Honey Hai",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Comedy",
"Isrecommended": "1"
,
"programmeid": "30000000549646489",
"starttime": "2014-02-25T13:55:00+05:30",
"endtime": "2014-02-25T17:15:00+05:30",
"channelid": "10000000000110000",
"programmename": "Farz",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Drama",
"Isrecommended": "1"
,
"programmeid": "30000000549709799",
"starttime": "2014-02-25T17:15:00+05:30",
"endtime": "2014-02-25T20:00:00+05:30",
"channelid": "10000000000110000",
"programmename": "Action Replayy",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Comedy",
"Isrecommended": "1"
,
"programmeid": "30000000549664553",
"starttime": "2014-02-25T20:00:00+05:30",
"endtime": "2014-02-25T23:25:00+05:30",
"channelid": "10000000000110000",
"programmename": "Indian",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Action",
"Isrecommended": "1"
,
"programmeid": "30000000549781987",
"starttime": "2014-02-25T23:25:00+05:30",
"endtime": "2014-02-26T00:00:00+05:30",
"channelid": "10000000000110000",
"programmename": "Narsimha - Man Of Power",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Drama",
"Isrecommended": "1"
,
"programmeid": "30000000549741259",
"starttime": "2014-02-25T00:00:00+05:30",
"endtime": "2014-02-25T02:00:00+05:30",
"channelid": "10000000000540000",
"programmename": "The Dirty Picture",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Drama",
"Isrecommended": "1"
,
"programmeid": "30000000549867681",
"starttime": "2014-02-25T02:00:00+05:30",
"endtime": "2014-02-25T02:40:00+05:30",
"channelid": "10000000000540000",
"programmename": "Extraa Shots Special",
"m2ecategoryname": "TV Show",
"m2esubcategoryname": "Entertainment",
"Isrecommended": "1"
,
"programmeid": "30000000549867681",
"starttime": "2014-02-25T02:40:00+05:30",
"endtime": "2014-02-25T03:00:00+05:30",
"channelid": "10000000000540000",
"programmename": "Extraa Shots Special",
"m2ecategoryname": "TV Show",
"m2esubcategoryname": "Entertainment",
"Isrecommended": "1"
,
"programmeid": "30000000549867681",
"starttime": "2014-02-25T03:00:00+05:30",
"endtime": "2014-02-25T03:25:00+05:30",
"channelid": "10000000000540000",
"programmename": "Extraa Shots Special",
"m2ecategoryname": "TV Show",
"m2esubcategoryname": "Entertainment",
"Isrecommended": "1"
,
"programmeid": "30000000549867681",
"starttime": "2014-02-25T03:25:00+05:30",
"endtime": "2014-02-25T03:40:00+05:30",
"channelid": "10000000000540000",
"programmename": "Extraa Shots Special",
"m2ecategoryname": "TV Show",
"m2esubcategoryname": "Entertainment",
"Isrecommended": "1"
,
"programmeid": "30000000549867681",
"starttime": "2014-02-25T03:40:00+05:30",
"endtime": "2014-02-25T04:00:00+05:30",
"channelid": "10000000000540000",
"programmename": "Extraa Shots Special",
"m2ecategoryname": "TV Show",
"m2esubcategoryname": "Entertainment",
"Isrecommended": "1"
,
"programmeid": "30000000549867681",
"starttime": "2014-02-25T04:00:00+05:30",
"endtime": "2014-02-25T04:25:00+05:30",
"channelid": "10000000000540000",
"programmename": "Extraa Shots Special",
"m2ecategoryname": "TV Show",
"m2esubcategoryname": "Entertainment",
"Isrecommended": "1"
,
"programmeid": "10000001078790000",
"starttime": "2014-02-25T18:08:00+05:30",
"endtime": "2014-02-25T20:30:00+05:30",
"channelid": "10000000000210000",
"programmename": "Aadmi",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Action",
"Isrecommended": "1"
,
"programmeid": "30000000549651842",
"starttime": "2014-02-25T20:30:00+05:30",
"endtime": "2014-02-25T23:16:00+05:30",
"channelid": "10000000000210000",
"programmename": "Dum",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Action",
"Isrecommended": "1"
,
"programmeid": "30000000549828153",
"starttime": "2014-02-25T23:16:00+05:30",
"endtime": "2014-02-26T00:00:00+05:30",
"channelid": "10000000000210000",
"programmename": "Aakhri Baazi",
"m2ecategoryname": "Film",
"m2esubcategoryname": "Romance",
"Isrecommended": "1"
],
"channelinfo": [
"ChannelID": "10000000000110000",
"ChannelName": "STAR GOLD",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000110000.png",
"ischannelfavorite": "false"
,
"ChannelID": "10000000000540000",
"ChannelName": "MAX",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000540000.png",
"ischannelfavorite": "false"
,
"ChannelID": "10000000000620000",
"ChannelName": "TEN SPORTS",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000620000.png",
"ischannelfavorite": "false"
,
"ChannelID": "10000000000700000",
"ChannelName": "HBO",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000700000.png",
"ischannelfavorite": "false"
,
"ChannelID": "10000000000100000",
"ChannelName": "STAR MOVIES",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000100000.png",
"ischannelfavorite": "false"
,
"ChannelID": "10000000000080000",
"ChannelName": "STAR PLUS",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000080000.png",
"ischannelfavorite": "false"
,
"ChannelID": "10000000000210000",
"ChannelName": "ZEE CINEMA",
"LCN": "0",
"Operator_Id": "2645",
"logofileurl": "http://images.whatsonindia.com/WhatsOnTv/Images/applicationchannellogo/10000000000210000.png",
"ischannelfavorite": "false"
]
它使用 CryptoJS 进行加密和解密。
【讨论】：
你是怎么得到这个链接的？你能解释一下吗？ 在 Chrome 控制台中。除了加载内容并等待ajax动态添加内容之外，找不到任何方法。我会尽快更新我的答案。 你是如何解密这个json代码的，请告诉你使用的是什么代码 你如何从 url 解密这个文本 我没有记下所有步骤，但我可以向您解释我做了什么。我从上面提到的 url 解析了 JSON 数据，设法使用他们正在使用的 CryptoJS 库对其进行解密。解密函数位于名为“application ... .js”的引用 JS 库之一中。搜索“CryptoJS.AES.decrypt”...你会找到它。以上是关于如何使用 C# 获取检查元素代码的主要内容，如果未能解决你的问题，请参考以下文章
如何使用 C# ASP.Net 从 XML 文档中获取特定 XML 元素的列表？
如何使用 selenium webdriver C# 获取元素样式属性的值