网页采集程序（超级简单版）

9 W& L3 ^) b& K& f) k i

网页采集程序（超级简单版）

网页采集程序（超级简单版）
01 protected void btn_click(object sender, EventArgs e) 

02         { 

5 q; m/ A8 E" ]/ {9 ~0 P

03             //方法一： 

04             //System.Net.WebClient wc = new System.Net.WebClient(); 

05             //byte[] b = wc.DownloadData("http://www.baidu.com"); 

06             //string html = System.Text.Encoding.GetEncoding("gb2312").GetString(b); 

( Y2 z9 f' X- x( P' e# m. C

07             //html = html.Substring(html.IndexOf("<p id=\"lg\">") + "<p id=\"lg\">".Length); 

08             //html = html.Substring(0, html.IndexOf("</p>")); 

9 j3 Z+ Z- K4 j) ?6 Q* t! `+ C

09             //Response.Write(html); 

. ^8 h+ E0 [7 |* _& u

10   

3 q4 T0 p9 s3 R8 ~! N8 q

11             //方法二： 

- I8 r, |$ r5 S) H

12         //获取整个网页 

13             System.Net.WebClient wc = new System.Net.WebClient(); 

14             System.IO.Stream sm = wc.OpenRead("http://www.baidu.com"); 

15             System.IO.StreamReader sr = new System.IO.StreamReader(sm, System.Text.Encoding.Default, true, 256000); 

16             string html = sr.ReadToEnd(); 

! E3 E( [7 o* |6 e; R# }3 ~

17             sr.Close(); 

. q3 h( x1 O7 Y7 P

18             //根据规则获取想要的内容 

3 y) m+ S2 Q% ]' T }1 n

19             html = html.Substring(html.IndexOf("<p id=\"lg\">") + "<p id=\"lg\">".Length); 

6 y9 F4 l9 w2 @+ L( ]

20             html = html.Substring(0, html.IndexOf("</p>")); 

21             Response.Write(html); 

- d) p0 P/ K0 ^: Q

22         }

http://hereson.javaeye.com/blog/207468