——————怎么解析 gzip压缩字符串（ XMLHTTP 与AJAX页面的交互 ）
求助——————如何解析 gzip压缩字符串（ XMLHTTP 与AJAX页面的交互 ）
因为想要通过程序采集数据 目标网页是基于 AJAX（异步的JavaScript与XML技术），页面有 1.2.3.4......下一页
当你点击比如说第二页 此时按照ajax的原理 向服务器发送并取回必需的数据 并不是连接到另一个页面 所以网页的网址不会变 网页主体框架不会变 只有特定的区域会呈现新的内容
变 问题就在这里了
如果不是AJAX 而是下一个页面的连接的话 大可以从HTML中分析 得到该连接 然后打开该连接 即可获得目标数据
但是这个是同一个页面 就是有交互了 就是 post回 form表单 从而才能获到 其他2.3.4页的HTML 所以想要获得 异步传输来的数据 要交互 所以要模拟浏览器提交表单 申请异步数据 所以要解析 send 字符串
可是用捉包工具 捕获的 数据显示 人家send的是gzip压缩字符串
如何解析呢？？？ 如果压缩还可以加密的话 那我想应该是没有办法了
http 头
因为想要通过程序采集数据 目标网页是基于 AJAX（异步的JavaScript与XML技术），页面有 1.2.3.4......下一页
当你点击比如说第二页 此时按照ajax的原理 向服务器发送并取回必需的数据 并不是连接到另一个页面 所以网页的网址不会变 网页主体框架不会变 只有特定的区域会呈现新的内容
变 问题就在这里了
如果不是AJAX 而是下一个页面的连接的话 大可以从HTML中分析 得到该连接 然后打开该连接 即可获得目标数据
但是这个是同一个页面 就是有交互了 就是 post回 form表单 从而才能获到 其他2.3.4页的HTML 所以想要获得 异步传输来的数据 要交互 所以要模拟浏览器提交表单 申请异步数据 所以要解析 send 字符串
可是用捉包工具 捕获的 数据显示 人家send的是gzip压缩字符串
如何解析呢？？？ 如果压缩还可以加密的话 那我想应该是没有办法了
http 头
- HTML code
Content-Type: application/x-www-form-urlencoded Accept-Encoding: gzip, deflate Host: Content-Length: 18844 Connection: Keep-Alive Cache-Control: no-cache Cookie: ASP.NET_SessionId=olrgsku0svkkxa45qfefvo45; pageReferrInSession=; __utmc=160996513; Hm_lpvt_af200f4e2bd61323503aebc2689d62cb=1323322114298; .ASPXANONYMOUS=QS0KM9vrzAEkAAAAODQzN2RlMzUtNzYyZC00ZWIwLWE0ZTItNDc1OWRiZDI1Yjc2SEEjK1Eh2LxTEuk0SuwtBkuoR-Q1; __utma=160996513.530588852.1323308021.1323311368.1323321985.3; __utmz=160996513.1323308021.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); Hm_lvt_af200f4e2bd61323503aebc2689d62cb=1323321985098; __utmb=160996513.18.10.1323321985 这个是 send 的内容 __VIEWSTATE=%2FwEPDwUKLTk5MTgyMjA2MQ8WCh4KQXV0aG9yTmFtZQUJ5byg5LiJ5aWHHgVRdWVyeQUnQXV0aG9ySUQgZXhhY3QgIkEwMDAwMTAzOTgiIHNvcnRieSBkYXRlHg9ZZWFyQWxsQXRydGljbGUF2BU8bGk%2BPGEgIGhyZWY9J2h0dHA6Ly9zby5tZWQud2FuZmFuZ2RhdGEuY29tLmNuL1NlYXJjaFJlc3VsdC5hc3B4P0RCPTEyNDUzJlNxdz1BdXRob3JJRCtleGFjdCtBMDAwMDEwMzk4K2FuZCtEYXRlK3dpdGhpbislMjIyMDA4LTAxLTAxKzIwMDgtMTItMzElMjInICB0YXJnZXQ9J19ibGFuayc%2BMjAwOOW5tOW6pjwvYT48YiBuYW1lPSdCbnVtQmFyJyBjbGFzcz0nbnVtQmFyJyBzdHlsZT0nd2lkdGg6OTBweCc%2BPC9iPiA8c2NyaXB0IHR5cGU9InRleHQvamF2YXNjcmlwdCI%2BQWRkQ291bnQoMSk7PC9zY3JpcHQ%2BPHNwYW4%2BMTwvc3Bhbj48L2xpPjxsaT48YSAgaHJlZj0naHR0cDovL3NvLm1lZC53YW5mYW5nZGF0YS5jb20uY24vU2VhcmNoUmVzdWx0LmFzcHg%2FREI9MTI0NTMmU3F3PUF1dGhvcklEK2V4YWN0K0EwMDAwMTAzOTgrYW5kK0RhdGUrd2l0aGluKyUyMjIwMDctMDEtMDErMjAwNy0xMi0zMSUyMicgIHRhcmdldD0nX2JsYW5rJz4yMDA35bm05bqmPC9hPjxiIG5hbWU9J0JudW1CYXInIGNsYXNzPSdudW1CYXInIHN0eWxlPSd3aWR0aDo5MHB4Jz48L2I%2BIDxzY3JpcHQgdHlwZT0idGV4dC9qYXZhc2NyaXB0Ij5BZGRDb3VudCg4KTs8L3NjcmlwdD48c3Bhbj44PC9zcGFuPjwvbGk%2BPGxpPjxhICBocmVmPSdodHRwOi8vc28ubWVkLndhbmZhbmdkYXRhLmNvbS5jbi9TZWFyY2hSZXN1bHQuYXNweD9EQj0xMjQ1MyZTcXc9QXV0aG9ySUQrZXhhY3QrQTAwMDAxMDM5OCthbmQrRGF0ZSt3aXRoaW4rJTIyMjAwNi0wMS0wMSsyMDA2LTEyLTMxJTIyJyAgdGFyZ2V0PSdfYmxhbmsnPjIwMDblubTluqY8L2E%2BPGIgbmFtZT0nQm51bUJhcicgY2xhc3M9J251bUJhcicgc3R5bGU9J3dpZHRoOjkwcHgnPjwvYj4gPHNjcmlwdCB0eXBlPSJ0ZXh0L2phdmFzY3JpcHQiPkFkZENvdW50KDYpOzwvc2NyaXB0PjxzcGFuPjY8L3NwYW4%2BPC9saT48bGk%2BPGEgIGhyZWY9J2h0dHA6Ly9zby5tZWQud2FuZmFuZ2RhdGEuY29tLmNuL1NlYXJjaFJlc3VsdC5hc3B4P0RCPTEyNDUzJlNxdz1BdXRob3JJRCtleGFjdCtBMDAwMDEwMzk4K2FuZCtEYXRlK3dpdGhpbislMjIyMDA1LTAxLTAxKzIwMDUtMTItMzElMjInICB0YXJnZXQ9J19ibGFuayc%2BMjAwNeW5tOW6pjwvYT48YiBuYW1lPSdCbnVtQmFyJyBjbGFzcz0nbnVtQmFyJyBzdHlsZT0nd2lkdGg6OTBweCc%2BPC9iPiA8c2NyaXB0IHR5cGU9InRleHQvamF2YXNjcmlwdCI%2BQWRkQ291bnQoOSk7PC9zY3JpcHQ%2BPHNwYW4%2BOTwvc3Bhbj48L2xpPjxsaT48YSAgaHJlZj0naHR0cDovL3NvLm1lZC53YW5mYW5nZGF0YS5jb20uY24vU2VhcmNoUmVzdWx0LmFzcHg%2FREI9MTI0NTMmU3F3PUF1dGhvcklEK2V4YWN0K0EwMDAwMTAzOTgrYW5kK0RhdGUrd2l0aGluKyUyMjIwMDQtMDEtMDErMjAwNC0xMi0zMSUyMicgIHRhcmdldD0nX2JsYW5rJz4yMDA05bm05bqmPC9hPjxiIG5hbWU9J0JudW1CYXInIGNsYXNzPSdudW1CYXInIHN0eWxlPSd3aWR0aDo5MHB4Jz48L2I%2BIDxzY3JpcHQgdHlwZT0idGV4dC9qYXZhc2NyaXB0Ij5BZGRDb3VudCgxMCk7PC9zY3JpcHQ%2BPHNwYW4%2BMTA8L3NwYW4%2BPC9saT48bGk%2BPGEgIGhyZWY9J2h0dHA6Ly9zby5tZWQud2FuZmFuZ2RhdGEuY29tLmNuL1NlYXJjaFJlc3VsdC5hc3B4P0RCPTEyNDUzJlNxdz1BdXRob3JJRCtleGFjdCtBMDAwMDEwMzk4K2FuZCtEYXRlK3dpdGhpbislMjIyMDAzLTAxLTAxKzIwMDMtMTItMzElMjInICB0YXJnZXQ9J19ibGFuayc%2BMjAwM%2BW5tOW6pjwvYT48YiBuYW1lPSdCbnVtQmFyJyBjbGFzcz0nbnVtQmFyJyBzdHlsZT0nd2lkdGg6OTBweCc%2BPC9iPiA8c2NyaXB0IHR5cGU9InRleHQvamF2YXNjcmlwdCI%2BQWRkQ291bnQoMTIpOzwvc2NyaXB0PjxzcGFuPjEyPC9zcGFuPjwvbGk%2BPGxpPjxhICBocmVmPSdodHRwOi8vc28ubWVkLndhbmZhbmdkYXRhLmNvbS5jbi9TZWFyY2hSZXN1bHQuYXNweD9EQj0xMjQ1MyZTcXc9QXV0aG9ySUQrZXhhY3QrQTAwMDAxMDM5OCthbmQrRGF0ZSt3aXRoaW4rJTIyMjAwMi0wMS0wMSsyMDAyLTEyLTMxJTIyJyAgdGFyZ2V0PSdfYmxhbmsnPjIwMDLlubTluqY8L2E%2BPGIgbmFtZT0nQm51bUJhcicgY2xhc3M9J251bUJhcicgc3R5bGU9J3dpZHRoOjkwcHgnPjwvYj4gPHNjcmlwdCB0eXBlPSJ0ZXh0L2phdmFzY3JpcHQiPkFkZENvdW50KDUpOzwvc2NyaXB0PjxzcGFuPjU8L3NwYW4%2BPC9saT48bGk%2BPGEgIGhyZWY9J2h0dHA6Ly9zby5tZWQud2FuZmFuZ2RhdGEuY29tLmNuL1NlYXJjaFJlc3VsdC5hc3B4P0RCPTEyNDUzJlNxdz1BdXRob3JJRCtleGFjdCtBMDAwMDEwMzk4K2FuZCtEYXRlK3dpdGhpbislMjIyMDAxLTAxLTAxKzIwMDEtMTItMzElMjInICB0YXJnZXQ9J19ibGFuayc%2BMjAwMeW5tOW6pjwvYT48YiBuYW1lPSdCbnVtQmFyJyBjbGFzcz0nbnVtQmFyJyBzdHlsZT0nd2lkdGg6OTBweCc%2BPC9iPiA8c2NyaXB0IHR5cGU9InRleHQvamF2YXNjcmlwdCI%2BQWRkQ291bnQoOCk7PC9zY3JpcHQ%2BPHNwYW4%2BODwvc3Bhbj48L2xpPjxsaT48YSAgaHJlZj0naHR0cDovL3NvLm1lZC53YW5mYW5nZGF0YS5jb20uY24vU2VhcmNoUmVzdWx0LmFzcHg%2FREI9MTI0NTMmU3F3PUF1dGhvcklEK2V4YWN0K0EwMDAwMTAzOTgrYW5kK0RhdGUrd2l0aGluKyUyMjIwMDAtMDEtMDErMjAwMC0xMi0zMSUyMicgIHRhcmdldD0nX2JsYW5rJz4yMDAw5bm05bqmPC9hPjxiIG5hbWU9J0JudW1CYXInIGNsYXNzPSdudW1CYXInIHN0eWxlPSd3aWR0aDo5MHB4Jz48L2I%2BIDxzY3JpcHQgdHlwZT0idGV4dC9qYXZhc2NyaXB0Ij5BZGRDb3VudCg0KTs8L3NjcmlwdD48c3Bhbj40PC9zcGFuPjwvbGk%2BHgdLZXlXb3JrBd9GPGEgaHJlZj0naHR0cDovL3NvLm1lZC53YW5mYW5nZGF0YS5jb20uY24vU2VhcmNoUmVzdWx0LmFzcHg%2FREI9MTI0NTMmU3F3PUtXRCUzRCUyMiVlOCU5OSU4ZSVlNiU5ZCU5NiUyMiZzb3J0UVc9JnFpa2FuUVY9JmFkU3RyPSVlOCU5OSU4ZSVlNiU5ZCU5NicgY2xhc3M9ImxuazEiPuiZjuadljwvYT4gICA8YSBocmVmPSdodHRwOi8vc28ubWVkLndhbmZhbmdkYXRhLmNvbS5jbi9TZWFyY2hSZXN1bHQuYXNweD9EQj0xMjQ1MyZTcXc9S1dEJTNEJTIyJWU1JThmJThkJWU3JTliJWI4JWU5JWFiJTk4JWU2JTk1JTg4JWU2JWI2JWIyJWU3JTliJWI4JWU4JTg5JW