[ Jsoup ] 알아두면 좋은 Jsoup 대처법

1. Ajax 크롤링시 타입에러 발생시

Document gjSite = Jsoup.connect("https://www.gwangju.go.kr/c19/c19Main.do")
			    .header("Origin", "https://www.gwangju.go.kr")
	                    .header("Referer", "https://www.gwangju.go.kr/c19/")
	                    .ignoreContentType(true)
	                    .post();
ObjectMapper om = new ObjectMapper();
JsonNode jn =  om.readTree(gjSite.select("body").text());

* Ajax 호출시 컨텐트 타입 에러가 발생할 경우 .ignoreContentType(true) 추가

 

 

2. https 연결시 unable to find valid certification path to requested target 에러 발생시

TrustManager[] trustAllCerts = new TrustManager[]{new X509TrustManager() {
			
			@Override
			public X509Certificate[] getAcceptedIssuers() {
				// TODO Auto-generated method stub
				return  new X509Certificate[0];
			}
			
			@Override
			public void checkServerTrusted(X509Certificate[] chain, String authType) throws CertificateException {
				// TODO Auto-generated method stub
				
			}
			
			@Override
			public void checkClientTrusted(X509Certificate[] chain, String authType) throws CertificateException {
				// TODO Auto-generated method stub
				
			}
	    }};

        SSLContext sc = SSLContext.getInstance("TLS");
        sc.init(null, trustAllCerts, new SecureRandom());
        HttpsURLConnection.setDefaultSSLSocketFactory(sc.getSocketFactory());

위와 같이 코드를 추가하여 HTTPS 인증