java 版 chsi.com.cn 模拟登陆（java模拟登录系统）

25-04-29 1

本文将带您了解关于java版chsi.com.cn模拟登陆的新内容，同时我们还将为您解释java模拟登录系统的相关知识，另外，我们还将为您提供关于Flask-testing（一）——模拟登陆、gith

本文将带您了解关于java 版 chsi.com.cn 模拟登陆的新内容，同时我们还将为您解释java模拟登录系统的相关知识，另外，我们还将为您提供关于Flask-testing（一）—— 模拟登陆、github 模拟登陆、htmlunit 模拟登陆 https、HttpClient + Jsoup 模拟登陆，解析 HTML, 信息筛选（广工图书馆）的实用信息。

本文目录一览：

java 版 chsi.com.cn 模拟登陆（java模拟登录系统）
Flask-testing（一）—— 模拟登陆
github 模拟登陆
htmlunit 模拟登陆 https
HttpClient + Jsoup 模拟登陆，解析 HTML, 信息筛选（广工图书馆）

java 版 chsi.com.cn 模拟登陆（java模拟登录系统）

直接上代码登陆 chsi.com.cn 测试：


		// TODO Auto-generated method stub
		String url = "https://account.chsi.com.cn/passport/login?service=https://my.chsi.com.cn/archive/j_spring_cas_security_check";
		String userAgent = "Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.87 Safari/537.36";
        RequestConfig requestConfig = RequestConfig.custom()
                .setConnectTimeout(5000*10)   //设置连接超时时间
                .setConnectionRequestTimeout(5000*10) // 设置请求超时时间
                .setSocketTimeout(5000*10)
                .setRedirectsEnabled(true)//默认允许自动重定向
                .build();
        CloseableHttpClient httpCilent = HttpClients.createDefault();
        HttpGet httpGet = new HttpGet(url);
        httpGet.setHeader("User-Agent",userAgent);
        httpGet.setConfig(requestConfig);
        HttpResponse httpResponse = httpCilent.execute(httpGet);
        HttpEntity entity = httpResponse.getEntity();
        String contentString = EntityUtils.toString(entity,"utf-8");
        Document document = Jsoup.parse(contentString);
        Elements eles = document.select("input[type=hidden]");
        List<BasicNameValuePair> list = new ArrayList<BasicNameValuePair>();
        for (Element element : eles) {
			String nameString = element.attr("name");
			String valueString = element.attr("value");
			list.add(new BasicNameValuePair(nameString, valueString));
		}
        
        list.add(new BasicNameValuePair("username", "你的用户名"));
        list.add(new BasicNameValuePair("password", "你的密码"));
        
        HttpPost post = new HttpPost(url);
        post.setHeader("User-Agent",userAgent);
        post.setHeader("Referer","https://account.chsi.com.cn/passport/login?service=https://my.chsi.com.cn/archive/j_spring_cas_security_check");
        HttpEntity ent = new UrlEncodedFormEntity(list, "UTF-8");
        post.setEntity(ent);
        httpResponse = httpCilent.execute(post);
        
        
       // httpGet = new HttpGet("https://my.chsi.com.cn/archive/gdjy/xj/show.action");
        httpGet = new HttpGet("https://account.chsi.com.cn/account/account!show");
        httpGet.setHeader("User-Agent",userAgent);
        httpGet.setConfig(requestConfig);
        httpResponse = httpCilent.execute(httpGet);
        entity = httpResponse.getEntity();
        contentString = EntityUtils.toString(entity,"utf-8");
        System.out.println("======================-----下面就是登陆后的东西 请拷贝查看-----=================");
        System.out.println(contentString);

Flask-testing（一）—— 模拟登陆

web单元测试

web单元测试可以分为三类：

测试对象较独立，无需依赖于cookie之类的上下文
依赖于上下文
web前端的测试。

测试方式推荐：

第一种类型只需要使用unittest的常规测试即可
第三种类型可使用selenium，但是编写selenium工作量比较大，且不够直观，且不够只管，建议使用其他方式或者人工测试
第二种类型，例如对于login_required类型的endpoint，可使用app.test_client()返回测试客户端，同时附带上合适的数据。推荐使用flask-testing插件。同时，由于这类依赖比较常见，所以推荐将其独立成类。

代码组织推荐：

尽量只再endpoint中编写参数解析与response封装工作，其他代码再独立成为一个逻辑函数
测试时，依赖于某些数据，除非测试数据的增删改，否则建议编写数据导入函数（后续写），可以减少工作量

flask-testing简介

Flask-testing是对unittest的一个封装，
使用之前需要先用create_app()返回一个app即可使用，可以使用client属性模拟客户端访问，
例如：client.get(''/'', headers={''Cookie'':cookie})，
例如：client.post(''/'', data=parama, follow_redirects=True)。
其他使用方式与unittest相似。

登陆

有一些测试实例需要登陆后才能执行，为了方便登陆管理，建议把登陆相关独立成为一个Plugin类。调用该类即可。

传入unittest实例，通过unittest实例的get，post方法登陆
先用get方法获得登陆页，在html中提取csrf_token
再用post方法，将phone，passwod，csrf_token发送，follow_redirects=True跳转
在判断是否还停留再登陆页
将cookie提取出来，用于以后登陆携带访问

class LoginPlugin(object):
    def __init__(self, flask_unittest):
        self.unittest = flask_unittest
        self.cookie = None

    def create_app(self):
        www = create_www_app(''testing'')
        db.init_app(www)
        return www

    def login(self, phone=''13800000008'', password=''123456''):
        # 获取csrf_token
        login_html = self.unittest.client.get(url_for(''auth.login'')).data
        login_bs = BeautifulSoup(login_html, ''html5lib'')
        csrf_token = login_bs.find(id=''csrf_token'')[''value'']
        if not re.search(''登陆'', login_html):
            # 登陆页打不开
            return False

        # 访问数据库
        params = {''phone'': phone, ''password'': password, ''csrf_token'': csrf_token}
        result = self.unittest.client.post(url_for(''auth.login''), data=params, follow_redirects=True)
        self.cookie = result.headers[''Set-Cookie'']
        result_data = result.data

        # True为登陆成功，False未登陆失败
        return not re.search(''登陆'', result_data)

    def get_cookie(self):
        return self.cookie

    def logout(self):
        return self.unittest.client.post(''/logout'')

使用例子


    class CartTest(TestCase):
        is_login = None
    
        def create_app(self):
            self.login_plugin = LoginPlugin(self)
            return self.login_plugin.create_app()
    
        def setUp(self):
            self.login_plugin.login()
            self.cookie = self.login_plugin.get_cookie()
    
        def test_show_cart_json(self):
            json_info = self.client.get(url_for(''order.show_cart_json''), \
                headers={''Cookie'': self.cookie}).data  # order.show_cart_json''依赖于current_user.get_id()所以得先登陆
            result = json.loads(json_info)
            self.assertEqual(len(result[''data'']), 2)

github 模拟登陆

import requests
from bs4 import BeautifulSoup

USERNAME = ''*****''
PWD = ''*******''

LoginUrl_GET = ''https://github.com/login''
LoginUrl = ''https://github.com/session''

headers = {
    ''Host'': ''github.com'',
    ''User-Agent'': ''Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:47.0) Gecko/20100101 Firefox/47.0'',
    ''Accept'': ''text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'',
    ''Accept-Language'': ''en-US,en;q=0.5'',
    ''Accept-Encoding'': ''gzip, deflate, br'',
    ''Referer'': ''https://github.com'',
    ''Connection'': ''keep-alive'',
}
formData = {
    ''commit'': ''Sign+in'',
    ''utf8'': "✓",
    "login": USERNAME,
    "password": PWD,

}
s = requests.Session()
RESULT = s.get(LoginUrl_GET, headers=headers)


content = RESULT.content

with open(''login.html'', ''wb'') as fp:
    fp.write(content)
html = open(''login.html'', ''r'')
soup = BeautifulSoup(html, "html.parser")
token = soup.find(''input'', {''name'': ''authenticity_token''})[''value'']



formData[''authenticity_token''] = token





# RESULT = s.post(LoginUrl, headers=headers, data=formData,)
RESULT = s.post(LoginUrl, data=formData,)


content=RESULT.content
print RESULT.url

print RESULT.status_code
print RESULT.cookies

with open(''bitbucket.html'', ''w'') as fp:
    fp.write(content)

https://github.com/FizLBQ/SpiderPython

htmlunit 模拟登陆 https

htmlunit 模拟登陆 https 博客分类： java

public static void htmlUnitUrl(String url, String ip, String port)
			throws Exception {
		WebClient client=null;
		try {
			 client = new WebClient(BrowserVersion.FIREFOX_24,ip,Integer.valueOf(port));  
	         client.getOptions().setUseInsecureSSL(true);
	         client.getOptions().setCssEnabled(false);
	         client.getOptions().setJavaScriptEnabled(false);
	        //获取某网站页面  
	        HtmlPage page = client.getPage(url); 
		} catch (Exception e) {
			logger.error("激活连接出错", e);
		} finally {
			if(client!=null){
				client.closeAllWindows();
			}
		}
	}

HttpClient + Jsoup 模拟登陆，解析 HTML, 信息筛选（广工图书馆）

HttpClient + Jsoup 模拟登陆，解析 HTML 获取信息

微博：http://weibo.com/375061590

QQ ：375061590

最近在做一个校园综合 Android 客户端，主要是想把学校各类网站信息进行整合，放在一个平台上，供学校学生阅览。

思路如下：

拿广东工业大学图书馆网站作为一个例子

实现目标：用个人账号登陆图书馆并获取到个人借阅情况。

登陆地址 http://222.200.98.171:81/login.aspx

这里会用到 Chrome 的开发者工具（浏览器按 F12 可以开启）

打开登陆界面的源码，下面是源码中的 form 标签

Html 代码

<form name="aspnetForm" method="post" action="login.aspx?ReturnUrl=%2fuser%2fuserinfo.aspx" onsubmit="javascript:return WebForm_OnSubmit();" id="aspnetForm">
<div>
<input type="hidden" name="__EVENTTARGET" id="__EVENTTARGET" value="" />
<input type="hidden" name="__EVENTARGUMENT" id="__EVENTARGUMENT" value="" />
<input type="hidden" name="__VIEWSTATE" id="__VIEWSTATE" value="/wEPDwULLTE0MjY3MDAxNzcPZBYCZg9kFgoCAQ8PFgIeCEltYWdlVXJsBRt+XGltYWdlc1xoZWFkZXJvcGFjNGdpZi5naWZkZAICDw8WAh4EVGV4dAUt5bm/5Lic5bel5Lia5aSn5a2m5Zu+5Lmm6aaG5Lmm55uu5qOA57Si57O757ufZGQCAw8PFgIfAQUcMjAxM+W5tDAz5pyIMDXml6UgIOaYn+acn+S6jGRkAgQPZBYEZg9kFgQCAQ8WAh4LXyFJdGVtQ291bnQCCBYSAgEPZBYCZg8VAwtzZWFyY2guYXNweAAM55uu5b2V5qOA57SiZAICD2QWAmYPFQMTcGVyaV9uYXZfY2xhc3MuYXNweAAM5YiG57G75a+86IiqZAIDD2QWAmYPFQMOYm9va19yYW5rLmFzcHgADOivu+S5puaMh+W8lWQCBA9kFgJmDxUDCXhzdGIuYXNweAAM5paw5Lmm6YCa5oqlZAIFD2QWAmYPFQMUcmVhZGVycmVjb21tZW5kLmFzcHgADOivu+iAheiNkOi0rWQCBg9kFgJmDxUDE292ZXJkdWVib29rc19mLmFzcHgADOaPkOmGkuacjeWKoWQCBw9kFgJmDxUDEnVzZXIvdXNlcmluZm8uYXNweAAP5oiR55qE5Zu+5Lmm6aaGZAIID2QWAmYPFQMbaHR0cDovL2xpYnJhcnkuZ2R1dC5lZHUuY24vAA/lm77kuabppobpppbpobVkAgkPZBYCAgEPFgIeB1Zpc2libGVoZAIDDxYCHwJmZAIBD2QWBAIDD2QWBAIBDw9kFgIeDGF1dG9jb21wbGV0ZQUDb2ZmZAIHDw8WAh8BZWRkAgUPZBYGAgEPEGRkFgFmZAIDDxBkZBYBZmQCBQ8PZBYCHwQFA29mZmQCBQ8PFgIfAQWlAUNvcHlyaWdodCAmY29weTsyMDA4LTIwMDkuIFNVTENNSVMgT1BBQyA0LjAxIG9mIFNoZW56aGVuIFVuaXZlcnNpdHkgTGlicmFyeS4gIEFsbCByaWdodHMgcmVzZXJ2ZWQuPGJyIC8+54mI5p2D5omA5pyJ77ya5rex5Zyz5aSn5a2m5Zu+5Lmm6aaGIEUtbWFpbDpzenVsaWJAc3p1LmVkdS5jbmRkZL5QuJMrEZz+0UxuTVpXZ/EaY5A4" />
</div>
<script type="text/javascript">
//<![CDATA[
var theForm = document.forms[''aspnetForm''];
if (!theForm) {
theForm = document.aspnetForm;
}
function __doPostBack(eventTarget, eventArgument) {
if (!theForm.onsubmit || (theForm.onsubmit() != false)) {
theForm.__EVENTTARGET.value = eventTarget;
theForm.__EVENTARGUMENT.value = eventArgument;
theForm.submit();
}
}
//]]>
</script>
<script src="/WebResource.axd?d=kbLQnwjf5uNQN4GcWRC5kD1rIySOzkR3uLyKE5xUO0j4Fa2lQPZwQlk_qYaspRXtlojncSBfRJNkA00qXOMQqsKd8WY1&t=634751988274393221" type="text/javascript"></script>
<script src="/WebResource.axd?d=nsbO6ZJty6_6fuRufFNYnRiJ-xEoD0xQr70NX6g0v64gngATPLSnyyt7jyZkELLW6THXmh92_m0Y5TyvhES_-JroQeU1&t=634751988274393221" type="text/javascript"></script>
<script type="text/javascript">
//<![CDATA[
function WebForm_OnSubmit() {
if (typeof(ValidatorOnSubmit) == "function" && ValidatorOnSubmit() == false) return false;
return true;
}
//]]>
</script>
<div>
<input type="hidden" name="__EVENTVALIDATION" id="__EVENTVALIDATION" value="/wEWBQKa7ezdCwKOmK5RApX9wcYGAsP9wL8JAqW86pcIaBhXmFYzd5pGDTk/afln2TfArPw=" />
</div>
<input name="ctl00$ContentPlaceHolder1$txtlogintype" type="hidden" id="ctl00_ContentPlaceHolder1_txtlogintype" value="0" />
<div id="Login" class="clearFix">
<div class="LoginTitle">
登录我的图书馆
</div>
<div class="LeftLogin">
<div class="LoginDiv">
<div class="loginContent">
<div class="loginInfo">
<span class="leftInfo"> 图书证号：</span>
<span class="rightInfo">
<input name="ctl00$ContentPlaceHolder1$txtUsername_Lib" type="text" id="ctl00_ContentPlaceHolder1_txtUsername_Lib" class="txtInput" autocomplete="off" /><span id="ctl00_ContentPlaceHolder1_rfv_UserName_Lib" style="color:Red;display:none;"> 请输入证号 </span>
</span>
</div>
<div class="loginInfo">
<span class="leftInfo"> 密 & nbsp;        码：</span>
<span class="rightInfo">
<input name="ctl00$ContentPlaceHolder1$txtPas_Lib" type="password" id="ctl00_ContentPlaceHolder1_txtPas_Lib" class="txtInput" /><span id="ctl00_ContentPlaceHolder1_rfv_Password_Lib" style="color:Red;display:none;"> 请输入密码 </span>
</span>
</div>
<div>
<span id="ctl00_ContentPlaceHolder1_lblErr_Lib"></span>
</div>
<div class="loginInfo">
<input type="submit" name="ctl00$ContentPlaceHolder1$btnLogin_Lib" value="登录" onclick="javascript:WebForm_DoPostBackWithOptions(new WebForm_PostBackOptions("ctl00$ContentPlaceHolder1$btnLogin_Lib", "", true, "", "", false, false))" id="ctl00_ContentPlaceHolder1_btnLogin_Lib" class="btn" />
<input type="button" value="清空" onclick="rset()" class="btn"/>
</div>
</div>
</div>
</div>
<div class="RightDescription">
<img src="images/pin.gif" /> <br/>
1. 如果您使用的是公共电脑，请在使用完毕后，务必退出登录，以保安全。<br />
2. 首次登录，请先 <a href="changepas.aspx"> 修改初始密码 </a>。
</div>
</div>
<script type="text/javascript">
//<![CDATA[
var Page_Validators = new Array(document.getElementById("ctl00_ContentPlaceHolder1_rfv_UserName_Lib"), document.getElementById("ctl00_ContentPlaceHolder1_rfv_Password_Lib"));
//]]>
</script>
<script type="text/javascript">
//<![CDATA[
var ctl00_ContentPlaceHolder1_rfv_UserName_Lib = document.all ? document.all["ctl00_ContentPlaceHolder1_rfv_UserName_Lib"] : document.getElementById("ctl00_ContentPlaceHolder1_rfv_UserName_Lib");
ctl00_ContentPlaceHolder1_rfv_UserName_Lib.controltovalidate = "ctl00_ContentPlaceHolder1_txtUsername_Lib";
ctl00_ContentPlaceHolder1_rfv_UserName_Lib.focusOnError = "t";
ctl00_ContentPlaceHolder1_rfv_UserName_Lib.errormessage = "请输入证号";
ctl00_ContentPlaceHolder1_rfv_UserName_Lib.display = "Dynamic";
ctl00_ContentPlaceHolder1_rfv_UserName_Lib.evaluationfunction = "RequiredFieldValidatorEvaluateIsValid";
ctl00_ContentPlaceHolder1_rfv_UserName_Lib.initialvalue = "";
var ctl00_ContentPlaceHolder1_rfv_Password_Lib = document.all ? document.all["ctl00_ContentPlaceHolder1_rfv_Password_Lib"] : document.getElementById("ctl00_ContentPlaceHolder1_rfv_Password_Lib");
ctl00_ContentPlaceHolder1_rfv_Password_Lib.controltovalidate = "ctl00_ContentPlaceHolder1_txtPas_Lib";
ctl00_ContentPlaceHolder1_rfv_Password_Lib.focusOnError = "t";
ctl00_ContentPlaceHolder1_rfv_Password_Lib.errormessage = "请输入密码";
ctl00_ContentPlaceHolder1_rfv_Password_Lib.display = "Dynamic";
ctl00_ContentPlaceHolder1_rfv_Password_Lib.evaluationfunction = "RequiredFieldValidatorEvaluateIsValid";
ctl00_ContentPlaceHolder1_rfv_Password_Lib.initialvalue = "";
//]]>
</script>
<script type="text/javascript">
//<![CDATA[
var Page_ValidationActive = false;
if (typeof(ValidatorOnLoad) == "function") {
ValidatorOnLoad();
}
function ValidatorOnSubmit() {
if (Page_ValidationActive) {
return ValidatorCommonOnSubmit();
}
else {
return true;
}
}
//]]>
</script>
</form>

里面很多代码，我们要从中提取出我们登陆所需要的表单信息，input 和 select 这些标签都是作为登陆表单内容，这里只有 input 标签我们就提取它就好了，代码如下：

initLoginParmas (String userName,StringpassWord) 和 getLoginFormData (String url) 两个方法

Java 代码

/**
* 初始化参数
*
* @param userName
* @param passWord
* @return
* @throws ParseException
* @throws IOException
*/
public static List<NameValuePair> initLoginParmas(String userName,
String passWord) throws ParseException, IOException {
List<NameValuePair> parmasList = new ArrayList<NameValuePair>();
HashMap<String, String> parmasMap = getLoginFormData(LoginUrl);
Set<String> keySet = parmasMap.keySet();
for (String temp : keySet) {
if (temp.contains("Username")) {
parmasMap.put(temp, userName);
} else if (temp.contains("txtPas")) {
parmasMap.put(temp, passWord);
}
}
Set<String> keySet2 = parmasMap.keySet();
System.out.println("表单内容：");
for (String temp : keySet2) {
System.out.println(temp + " = " + parmasMap.get(temp));
}
for (String temp : keySet2) {
parmasList.add(new BasicNameValuePair(temp, parmasMap.get(temp)));
}
// System.out.println("initParams \n" + parmasMap);
return parmasList;
}

Java 代码

/**
* 获取登录表单 input 内容
*
* @param url
* @return
* @throws IOException
* @throws ParseException
*/
public static HashMap<String, String> getLoginFormData(String url)
throws ParseException, IOException {
Document document = Jsoup.parse(getHtml(url));
Elements element1 = document.getElementsByTag("form");// 找出所有 form 表单
Element element = element1.select("[method=post]").first();// 筛选出提交方法为 post 的表单
Elements elements = element.select("input[name]");// 把表单中带有 name 属性的 input 标签取出
HashMap<String, String> parmas = new HashMap<String, String>();
for (Element temp : elements) {
parmas.put(temp.attr("name"), temp.attr("value"));// 把所有取出的 input，取出其 name，放入 Map 中
}
return parmas;
}

最后表单结果是：

表单内容：

Java 代码

ctl00$ContentPlaceHolder1$txtlogintype = 0
__VIEWSTATE = /wEPDwULLTE0MjY3MDAxNzcPZBYCZg9kFgoCAQ8PFgIeCEltYWdlVXJsBRt+XGltYWdlc1xoZWFkZXJvcGFjNGdpZi5naWZkZAICDw8WAh4EVGV4dAUt5bm/5Lic5bel5Lia5aSn5a2m5Zu+5Lmm6aaG5Lmm55uu5qOA57Si57O757ufZGQCAw8PFgIfAQUcMjAxM+W5tDAz5pyIMDXml6UgIOaYn+acn+S6jGRkAgQPZBYEZg9kFgQCAQ8WAh4LXyFJdGVtQ291bnQCCBYSAgEPZBYCZg8VAwtzZWFyY2guYXNweAAM55uu5b2V5qOA57SiZAICD2QWAmYPFQMTcGVyaV9uYXZfY2xhc3MuYXNweAAM5YiG57G75a+86IiqZAIDD2QWAmYPFQMOYm9va19yYW5rLmFzcHgADOivu+S5puaMh+W8lWQCBA9kFgJmDxUDCXhzdGIuYXNweAAM5paw5Lmm6YCa5oqlZAIFD2QWAmYPFQMUcmVhZGVycmVjb21tZW5kLmFzcHgADOivu+iAheiNkOi0rWQCBg9kFgJmDxUDE292ZXJkdWVib29rc19mLmFzcHgADOaPkOmGkuacjeWKoWQCBw9kFgJmDxUDEnVzZXIvdXNlcmluZm8uYXNweAAP5oiR55qE5Zu+5Lmm6aaGZAIID2QWAmYPFQMbaHR0cDovL2xpYnJhcnkuZ2R1dC5lZHUuY24vAA/lm77kuabppobpppbpobVkAgkPZBYCAgEPFgIeB1Zpc2libGVoZAIDDxYCHwJmZAIBD2QWBAIDD2QWBAIBDw9kFgIeDGF1dG9jb21wbGV0ZQUDb2ZmZAIHDw8WAh8BZWRkAgUPZBYGAgEPEGRkFgFmZAIDDxBkZBYBZmQCBQ8PZBYCHwQFA29mZmQCBQ8PFgIfAQWlAUNvcHlyaWdodCAmY29weTsyMDA4LTIwMDkuIFNVTENNSVMgT1BBQyA0LjAxIG9mIFNoZW56aGVuIFVuaXZlcnNpdHkgTGlicmFyeS4gIEFsbCByaWdodHMgcmVzZXJ2ZWQuPGJyIC8+54mI5p2D5omA5pyJ77ya5rex5Zyz5aSn5a2m5Zu+5Lmm6aaGIEUtbWFpbDpzenVsaWJAc3p1LmVkdS5jbmRkZL5QuJMrEZz+0UxuTVpXZ/EaY5A4
ctl00$ContentPlaceHolder1$txtPas_Lib = 密码不告诉你
__EVENTVALIDATION = /wEWBQKa7ezdCwKOmK5RApX9wcYGAsP9wL8JAqW86pcIaBhXmFYzd5pGDTk/afln2TfArPw=
ctl00$ContentPlaceHolder1$txtUsername_Lib = 3110006527
ctl00$ContentPlaceHolder1$btnLogin_Lib = 登录

接下来是要登陆获取权限也就是获取到 Cookie

代码如下：

Java 代码

/**
* 图书馆登陆
*
* @param context
* @return 返回登陆后的界面 Html 代码
* @throws ClientProtocolException
* @throws IOException
*/
public static String login() throws ClientProtocolException, IOException {
List<NameValuePair> parmasList = new ArrayList<NameValuePair>();
parmasList = initLoginParmas("3110006527", "2787457");
HttpPost post = new HttpPost(LoginUrl);
post.getParams().setParameter(ClientPNames.HANDLE_REDIRECTS, false);
// 阻止自动重定向，目的是获取第一个 ResponseHeader 的 Cookie 和 Location
post.setHeader("Content-Type",
"application/x-www-form-urlencoded;charset=gbk");
// 设置编码为 GBK
post.setEntity(new UrlEncodedFormEntity(parmasList, "GBK"));
HttpResponse response = new DefaultHttpClient().execute(post);
cookie = response.getFirstHeader("Set-Cookie").getValue();
// 取得 cookie 并保存起来
// System.out.println("cookie= " + cookie);
location = response.getFirstHeader("Location").getValue();
// 重定向地址，目的是连接到主页
mainUrl = Host + location;
// 构建主页地址
String html = getHtml(mainUrl);
return html;
}

登陆获取 Cookie 时候会遇到返回状态码是 302，这个时候 Post 方法的话，系统会自动重定向到 Location 地址，这时候你看到的 ResponseHeader 已经不是你登陆后返回的那个了，而是你访问重定向地址时候返回的 ResponseHeader，而 cookie 是含在登陆时候返回的 ResponseHeader 里面所以特别要注意添加语句

Java 代码

post.getParams().setParameter(ClientPNames.HANDLE_REDIRECTS,false);

给 Post 设置参数，这样就会阻止重定向，从而可以获取 Cookie 和 Location (为了访问主页界面)

Java 代码

cookie =response.getFirstHeader("Set-Cookie").getValue();

接下来需要做的是根据 Location 得到主页地址，用 Jsoup 去解析主页，分析出我的借书情况的页面地址

接下来我们访问其他网页的时候就需要用到 cookie 了，所以在用 post 或者 get 方法的时候要调用 addHeader（）或者 setHeader（）; 把 Cookie 设置进去

Java 代码

/**
* 获取网页 HTML 源代码
*
* @param url
* @return
* @throws ParseException
* @throws IOException
*/
private static String getHtml(String url) throws ParseException,
IOException {
// TODO Auto-generated method stub
HttpGet get = new HttpGet(url);
if ("" != cookie) {
get.addHeader("Cookie", cookie);
}
HttpResponse httpResponse = new DefaultHttpClient().execute(get);
HttpEntity entity = httpResponse.getEntity();
return EntityUtils.toString(entity);
}

通过 Chrome 浏览器分析页面源码，可以看到该标签

Java 代码

<a href="bookborrowed.aspx" > 当前借阅情况和续借 </a>

bookborrowed.aspx 这一段就是我们需要的

获取代码如下：

Java 代码

public static void getMyBorrowedBooks() {
try {
Document document = Jsoup.parse(login());
Elements elements1 = document
.getElementsContainingOwnText("当前借阅情况和续借");// 通过 text 关键字找到所要的 <a> 标签
String url = elements1.first().attr("href");
borrowedBooksUrl = mainUrl.substring(0,
mainUrl.lastIndexOf("/") + 1) + url;// 取值和 mainUrl 进行拼凑组织借阅情况地址
getBookBorrowedData(getHtml(borrowedBooksUrl));
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}

获取到借书情况的地址后，我们就去访问这个地址，获取源码。

我们所需要的事这部分的数据（只截取一部分）：

Java 代码

<tr>
<td width="5%">
续满
</td>
<td width="10%">2013-04-10</td>
<td width="35%"><a href="../bookinfo.aspx?ctrlno=571892" target="_blank"> 编写高质量代码 [专著]：改善 Java 程序的 151 个建议＝Writing solw Java cove：151 suggestons to improve your Java program／秦小波著 </a></td>
<td width="5%"> </td>
<td width="8%"> 中文图书 </td>
<td width="7%">A2973844</td>
<td width="10%">2012-12-05</td>
</tr>
<tr>

通过下面代码用 Jsoup 进行筛选

Java 代码

/**
* 获取借书情况具体数据（List<BookEntity>）
*
* @param src
* @return List<BookEntity>
*/
private static List<BookEntity> getBookBorrowedData(String src) {
List<BookEntity> data = new ArrayList<BookEntity>();
Document document = Jsoup.parse(src);
Element element = document.select("[id=borrowedcontent]").first()
.getElementsByTag("table").first();
Elements elements2 = element.getElementsByTag("tr");
for (Element temp2 : elements2) {
Elements elements3 = temp2.getElementsByTag("td");
BookEntity entity = new test().new BookEntity()
.setIsFullData(elements3.get(0).text())
.setData2Return(elements3.get(1).text())
.setName(elements3.get(2).text())
.setData2Borrowed(elements3.get(6).text());
data.add(entity);
}
data.remove(0);
System.out.println("借书情况 \n");
for (BookEntity temp : data) {
System.out.println(temp.getName() + "\n" + temp.getData2Borrowed()
+ "\n" + temp.getData2Return() + "\n"
+ temp.getIsFullData());
}
return data;
}

最后打印出来结果是：

Java 代码

借书情况
编写高质量代码 [专著]：改善 Java 程序的 151 个建议＝Writing solw Java cove：151 suggestons to improve your Java program／秦小波著
2012-12-05
2013-04-10
续满
疯狂 Java [专著]：突破程序员基本功的 16 课／李刚编著
2012-12-05
2013-04-10
续满
程序员修炼之道 [专著]：从小工到专家＝The pragmatic programmer：From journeyman to master：评注版／(美) Andrew Hunt,(美) David Thomas 著；周爱民，蔡学镛评注
2012-11-22
2013-04-10
续满
重构：改善既有代码的设计＝Refactoring：improving the design of existing code／(美) Martin Fowler 著；熊节译
2012-11-22
2013-04-10
续满
Android 高薪之路 [专著]：Android 程序员面试宝典／李宁编著
2012-11-29
2013-04-10
续满
Android 技术内幕 [专著]・系统卷＝Android internals・System／杨丰盛著
2012-12-04
2013-04-10
续满
我编程，我快乐 [专著]：程序员职业规划之道＝The passionate programmer：creating a remarkable career in software development／(美) Chad Fowler 著；于梦瑄译
2013-01-17
2013-04-17
续满

Java 代码

<strong> 完整代码：</strong>
package moniLogin;
import java.io.IOException;
import java.util.ArrayList;
import java.util.HashMap;
import java.util.Iterator;
import java.util.List;
import java.util.Set;
import org.apache.http.Header;
import org.apache.http.HeaderElement;
import org.apache.http.HttpEntity;
import org.apache.http.HttpResponse;
import org.apache.http.NameValuePair;
import org.apache.http.ParseException;
import org.apache.http.client.ClientProtocolException;
import org.apache.http.client.entity.UrlEncodedFormEntity;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.client.methods.HttpPost;
import org.apache.http.client.params.ClientPNames;
import org.apache.http.impl.client.DefaultHttpClient;
import org.apache.http.message.BasicNameValuePair;
import org.apache.http.util.EntityUtils;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;
public class test {
private static String LoginUrl = "http://222.200.98.171:81/login.aspx";
private static String Host = "http://222.200.98.171:81";
private static String mainUrl = "";
private static String borrowedBooksUrl = "";
private static String cookie = "";
private static String location = "";
/**
* @param args
*/
public static void main(String[] args) {
// TODO Auto-generated method stub
getMyBorrowedBooks();
}
public static void getMyBorrowedBooks() {
try {
Document document = Jsoup.parse(login());
Elements elements1 = document
.getElementsContainingOwnText("当前借阅情况和续借");// 通过 text 关键字找到所要的 <a> 标签
String url = elements1.first().attr("href");
borrowedBooksUrl = mainUrl.substring(0,
mainUrl.lastIndexOf("/") + 1) + url;// 取值和 mainUrl 进行拼凑组织借阅情况地址
getBookBorrowedData(getHtml(borrowedBooksUrl));
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
/**
* 获取借书情况具体数据（List<BookEntity>）
*
* @param src
* @return List<BookEntity>
*/
private static List<BookEntity> getBookBorrowedData(String src) {
List<BookEntity> data = new ArrayList<BookEntity>();
Document document = Jsoup.parse(src);
Element element = document.select("[id=borrowedcontent]").first()
.getElementsByTag("table").first();
Elements elements2 = element.getElementsByTag("tr");
for (Element temp2 : elements2) {
Elements elements3 = temp2.getElementsByTag("td");
BookEntity entity = new test().new BookEntity()
.setIsFullData(elements3.get(0).text())
.setData2Return(elements3.get(1).text())
.setName(elements3.get(2).text())
.setData2Borrowed(elements3.get(6).text());
data.add(entity);
}
data.remove(0);
System.out.println("借书情况 \n");
for (BookEntity temp : data) {
System.out.println(temp.getName() + "\n" + temp.getData2Borrowed()
+ "\n" + temp.getData2Return() + "\n"
+ temp.getIsFullData());
}
return data;
}
/**
* 图书馆登陆
*
* @param context
* @return 返回登陆后的界面 Html 代码
* @throws ClientProtocolException
* @throws IOException
*/
public static String login() throws ClientProtocolException, IOException {
List<NameValuePair> parmasList = new ArrayList<NameValuePair>();
parmasList = initLoginParmas("3110006527", "密码不告诉你");
HttpPost post = new HttpPost(LoginUrl);
post.getParams().setParameter(ClientPNames.HANDLE_REDIRECTS, false);
// 阻止自动重定向，目的是获取第一个 ResponseHeader 的 Cookie 和 Location
post.setHeader("Content-Type",
"application/x-www-form-urlencoded;charset=gbk");
// 设置编码为 GBK
post.setEntity(new UrlEncodedFormEntity(parmasList, "GBK"));
HttpResponse response = new DefaultHttpClient().execute(post);
cookie = response.getFirstHeader("Set-Cookie").getValue();
// 取得 cookie 并保存起来
// System.out.println("cookie= " + cookie);
location = response.getFirstHeader("Location").getValue();
// 重定向地址，目的是连接到主页
mainUrl = Host + location;
// 构建主页地址
String html = getHtml(mainUrl);
return html;
}
/**
* 获取网页 HTML 源代码
*
* @param url
* @return
* @throws ParseException
* @throws IOException
*/
private static String getHtml(String url) throws ParseException,
IOException {
// TODO Auto-generated method stub
HttpGet get = new HttpGet(url);
if ("" != cookie) {
get.addHeader("Cookie", cookie);
}
HttpResponse httpResponse = new DefaultHttpClient().execute(get);
HttpEntity entity = httpResponse.getEntity();
return EntityUtils.toString(entity);
}
/**
* 初始化参数
*
* @param userName
* @param passWord
* @return
* @throws ParseException
* @throws IOException
*/
public static List<NameValuePair> initLoginParmas(String userName,
String passWord) throws ParseException, IOException {
List<NameValuePair> parmasList = new ArrayList<NameValuePair>();
HashMap<String, String> parmasMap = getLoginFormData(LoginUrl);
Set<String> keySet = parmasMap.keySet();
for (String temp : keySet) {
if (temp.contains("Username")) {
parmasMap.put(temp, userName);
} else if (temp.contains("txtPas")) {
parmasMap.put(temp, passWord);
}
}
Set<String> keySet2 = parmasMap.keySet();
System.out.println("表单内容：");
for (String temp : keySet2) {
System.out.println(temp + " = " + parmasMap.get(temp));
}
for (String temp : keySet2) {
parmasList.add(new BasicNameValuePair(temp, parmasMap.get(temp)));
}
// System.out.println("initParams \n" + parmasMap);
return parmasList;
}
/**
* 获取登录表单 input 内容
*
* @param url
* @return
* @throws IOException
* @throws ParseException
*/
public static HashMap<String, String> getLoginFormData(String url)
throws ParseException, IOException {
Document document = Jsoup.parse(getHtml(url));
Elements element1 = document.getElementsByTag("form");// 找出所有 form 表单
Element element = element1.select("[method=post]").first();// 筛选出提交方法为 post 的表单
Elements elements = element.select("input[name]");// 把表单中带有 name 属性的 input 标签取出
HashMap<String, String> parmas = new HashMap<String, String>();
for (Element temp : elements) {
parmas.put(temp.attr("name"), temp.attr("value"));// 把所有取出的 input，取出其 name，放入 Map 中
}
return parmas;
}
class BookEntity {
/**
* 书名
*
*/
private String name;
/**
* 可借数
*/
private String leandableNum;
/**
* 索引号
*/
private String callNumber;
/**
* 作者
*/
private String writer;
/**
* 出版社
*/
private String publisher;
/**
* 还书时间
*/
private String data2Return;
/**
* 借书时间
*/
private String data2Borrowed;
/**
* 是否续满
*/
private String isFullData;
public BookEntity() {
}
public String getName() {
return name;
}
public String getLeandableNum() {
return leandableNum;
}
public String getCallNumber() {
return callNumber;
}
public String getWriter() {
return writer;
}
public String getPublisher() {
return publisher;
}
public BookEntity setName(String name) {
this.name = name;
return this;
}
public BookEntity setLeandableNum(String leandableNum) {
this.leandableNum = leandableNum;
return this;
}
public BookEntity setCallNumber(String callNumber) {
this.callNumber = callNumber;
return this;
}
public BookEntity setWriter(String writer) {
this.writer = writer;
return this;
}
public BookEntity setPublisher(String publisher) {
this.publisher = publisher;
return this;
}
public String getData2Return() {
return data2Return;
}
public String getData2Borrowed() {
return data2Borrowed;
}
public String getIsFullData() {
return isFullData;
}
public BookEntity setData2Return(String data2Return) {
this.data2Return = data2Return;
return this;
}
public BookEntity setData2Borrowed(String data2Borrowed) {
this.data2Borrowed = data2Borrowed;
return this;
}
public BookEntity setIsFullData(String isFullData) {
this.isFullData = isFullData;
return this;
}
}
}

关于 Jsoup 怎么使用这里就不详细说了，

详细请查阅这个网站：http://www.open-open.com/jsoup/

今天关于java 版 chsi.com.cn 模拟登陆和java模拟登录系统的分享就到这里，希望大家有所收获，若想了解更多关于Flask-testing（一）—— 模拟登陆、github 模拟登陆、htmlunit 模拟登陆 https、HttpClient + Jsoup 模拟登陆，解析 HTML, 信息筛选（广工图书馆）等相关知识，可以在本站进行查询。

本文标签：