淘寶IP地址庫采集器c#代碼

2020-01-24 02:59:18

字體：大中小

來源：轉載

供稿：網友

采集器概貌,如下:

最近做一個項目,功能類似于CNZZ站長統計功能，要求顯示Ip所在的省份市區/提供商等信息。網上的Ip純真數據庫，下載下來一看，發現沒提供商內容，省市區都很少，居然有XXX網吧，哥瞬間倒了。沒標準化、并且雜亂、還不連續的IP段、總體說來沒達到要求。

　　在百度上找啊找，找到淘寶Ip地址庫，官方介紹的相當誘人,準確率高，數據質量有保障，提供國家、省、市、縣、運營商全方位信息，信息維度廣，格式規范，但是限制每秒10次的訪問（這個比較無語）。

　　淘寶IP地址庫,提供API http://ip.taobao.com/

接口說明

　　1. 請求接口（GET）：
　　　　　　http://ip.taobao.com/service/getIpInfo.php?ip=[ip地址字串]
　　2. 響應信息：
　　　　　?。╦son格式的）國家、?。ㄗ灾螀^或直轄市）、市（縣）、運營商
　　3. 返回數據格式：
　　　　　　{"code":0,"data":{"ip":"210.75.225.254","country":"/u4e2d/u56fd","area":"/u534e/u5317",
　　　　　　　　"region":"/u5317/u4eac/u5e02","city":"/u5317/u4eac/u5e02","county":"","isp":"/u7535/u4fe1",
　　　　　　　　"country_id":"86","area_id":"100000","region_id":"110000","city_id":"110000",
　　　　　　　　"county_id":"-1","isp_id":"100017"}}

　　　　　　其中code的值的含義為，0：成功，1：失敗。

1 ：IP轉換

　　準備好工具,后面就好弄啦, IPHelper提供了各種,IP<->byte[]<->Long 轉換

復制代碼代碼如下:

public class IPHelper
        {
        /// <summary>
        /// ip轉成long
        /// </summary>
        /// <param name="ip"></param>
        /// <returns></returns>
        public static long Ip2Long(string ip)
        {
            byte[] bytes = Ip2Bytes(ip);
            return Bytes2Long(bytes);
        }
        /// <summary>
        /// long轉成ip
        /// </summary>
        /// <param name="ipLong"></param>
        /// <returns></returns>
        public static string Long2Ip(long ipLong)
        {
            byte[] bytes = Long2Bytes(ipLong);
            return Bytes2Ip(bytes);
        }
        /// <summary>
        /// long轉成byte[]
        /// </summary>
        /// <param name="ipvalue"></param>
        /// <returns></returns>
        public static byte[] Long2Bytes(long ipvalue)
        {
            byte[] b = new byte[4];
            for (int i = 0; i < 4; i++)
            {
                b[3 - i] = (byte)(ipvalue >> 8 * i & 255);
            }
            return b;
        }
        /// <summary>
        /// byte[]轉成long
        /// </summary>
        /// <param name="bt"></param>
        /// <returns></returns>
        public static long Bytes2Long(byte[] bt)
        {
            int x = 3;
            long o = 0;
            foreach (byte f in bt)
            {
                o += (long)f << 8 * x--;
            }
            return o;
        }
        /// <summary>
        /// ip轉成byte[]
        /// </summary>
        /// <param name="ip"></param>
        /// <returns></returns>
        public static byte[] Ip2Bytes(string ip)
        {
            string[] sp = ip.Split('.');
            return new byte[] { Convert.ToByte(sp[0]), Convert.ToByte(sp[1]), Convert.ToByte(sp[2]), Convert.ToByte(sp[3]) };
        }
        /// <summary>
        /// byte[]轉成ip
        /// </summary>
        /// <param name="bytes"></param>
        /// <returns></returns>
        public static string Bytes2Ip(byte[] bytes)
        {
            return string.Format("{0}.{1}.{2}.{3}"
                                   , bytes[0]
                                   , bytes[1]
                                   , bytes[2]
                                   , bytes[3]);
        }
    }

2 ：多線程瘋狂獲取IP

復制代碼代碼如下:

/// <summary>
        /// 描述:開始采集
        /// </summary>
        private void StratCollect()
        {
            foreach (Thread thread in ThreadList)
            {
                thread.Start();
            }
        }
        /// <summary>
        /// 描述:獲取要采集的ip long
        /// </summary>
        private long GetCurrentIp()
        {
            long curip = System.Threading.Interlocked.Increment(ref CurrentCollectIP);
            return curip;
        }
        /// <summary>
        /// 線程中采集的方法
        /// </summary>
        private void GetTaobaoData()
        {
            long currentipLong = GetCurrentIp();
            while (currentipLong <= EndIP)
            {
                try
                {
                    CaptureTaobaoIPData(currentipLong);
                }
                catch (Exception ex)
                {
                     TextLog.SetString(currentipLong + ex.Message);
                }
                currentipLong = GetCurrentIp();
            }
        }
        /// <summary>
        /// 描述:線程中采集并得到IP
        /// </summary>
        private void CaptureTaobaoIPData(long currentipLong)
        {
            string ip = IPHelper.Long2Ip(currentipLong);
            string url = string.Format(UrlFomat, ip);
            string js =HttpHelper. HttpRequest(url, Encoding.UTF8);
            taobaoIPdata m = Newtonsoft.Json.JsonConvert.DeserializeObject<TaobaoJsonData>(js).data;
            m.ipLong = currentipLong;
            //更新界面
            this.Invoke(new Action<taobaoIPdata>(v =>
            {
                taobaoIPdataList.Add(v);
                this.dgv.DataSource = taobaoIPdataList;
            }), m);

        }

3： Http請求的Json結果，并反序列化成對象

http請求這個相當簡單。網上一大把，這里主要說一下json序列化，在這里本人建議采用Newtonsoft.Json.dll 下載地址： http://json.codeplex.com/ 性能和兼容性達到最好

Http請求

復制代碼代碼如下:

public class HttpHelper
    {
        public static string HttpRequest(string url, Encoding encoding)
        {
            try
            {
                HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
                request.Timeout = 6 * 1000;
                request.Method = "GET";
                //得到處理結果
                HttpWebResponse response = (HttpWebResponse)request.GetResponse();
                Stream myResponseStream = response.GetResponseStream();
                StreamReader myStreamReader = new StreamReader(myResponseStream, encoding);
                string result = myStreamReader.ReadToEnd();
                return result;
            }
            catch (Exception ex)
            {
                throw ex;
            }

}

Json序列化

復制代碼代碼如下:

taobaoIPdata m = Newtonsoft.Json.JsonConvert.DeserializeObject<TaobaoJsonData>(js).data;

序列號對象taobaoIPdata

復制代碼代碼如下:

/// <summary>
    /// 淘寶數據
    /// </summary>
    public partial class taobaoIPdata
    {
        private long _ipLong;
        /// <summary>
        /// IP 長整形
        /// </summary>
        public long ipLong
        {
            get { return _ipLong; }
            set { _ipLong = value; }
        }

        private string _ip;
        /// <summary>
        /// IP地址
        /// </summary>
        public string ip
        {
            get { return _ip; }
            set { _ip = value; }
        }

        private string _country;
        /// <summary>
        /// 國家
        /// </summary>
        public string country
        {
            get { return _country; }
            set { _country = value; }
        }

        private string _country_id;
        /// <summary>
        /// 國家編號
        /// </summary>
        public string country_id
        {
            get { return _country_id; }
            set { _country_id = value; }
        }

        private string _area;
        /// <summary>
        /// 地區
        /// </summary>
        public string area
        {
            get { return _area; }
            set { _area = value; }
        }

        private string _area_id;
        /// <summary>
        /// 地區編號
        /// </summary>
        public string area_id
        {
            get { return _area_id; }
            set { _area_id = value; }
        }

        private string _region;
        /// <summary>
        /// 區域
        /// </summary>
        public string region
        {
            get { return _region; }
            set { _region = value; }
        }

        private string _region_id;
        /// <summary>
        /// 區域編號
        /// </summary>
        public string region_id
        {
            get { return _region_id; }
            set { _region_id = value; }
        }

        private string _city;
        /// <summary>
        ///城市
        /// </summary>
        public string city
        {
            get { return _city; }
            set { _city = value; }
        }

        private string _city_id;
        /// <summary>
        /// 城市編號
        /// </summary>
        public string city_id
        {
            get { return _city_id; }
            set { _city_id = value; }
        }

        private string _county;
        /// <summary>
        /// 縣
        /// </summary>
        public string county
        {
            get { return _county; }
            set { _county = value; }
        }

        private string _county_id;
        /// <summary>
        /// 縣編號
        /// </summary>
        public string county_id
        {
            get { return _county_id; }
            set { _county_id = value; }
        }

        private string _isp;
        /// <summary>
        /// 供應商
        /// </summary>
        public string isp
        {
            get { return _isp; }
            set { _isp = value; }
        }

        private string _isp_id;
        /// <summary>
        /// 供應商ID
        /// </summary>
        public string isp_id
        {
            get { return _isp_id; }
            set { _isp_id = value; }
        }

    }
    /// <summary>
    /// 淘寶api 返回的json數據
    /// </summary>
    public partial class TaobaoJsonData
    {
        public int code { get; set; }
        public taobaoIPdata data { get; set; }
    }

序列號對象taobaoIPdata

4：插入到數據庫中。。。剩下的自己隨便搞啦

源碼下載:淘寶IP獲取器.rar

上一篇：C#在后臺運行操作(BackgroundWorker用法)示例分享

下一篇：c#唯一值渲染實例代碼