카테고리 없음
2020-07-09 18시 개발자 글 모음 | "라온피플, '코스닥 라이징스타 202" 외 6개 이야기
데브피드
2020. 7. 9. 18:46
- V1인덱스에 색인한 파일을 사용하므로 V1을 제외한 나머지 9개의 인덱스에 동적색인 요청을 하고 9개의 인덱스 모두 동적색인이 마치는 시간까지를 측정했습니다
- FASTCAT의 각 인덱스당 437만건의 색인을 처리했으며 약 1시간 20분 이후 쌓여있던 모든 동적색인 요청이 끝났습니다
- 처음에는 동적색인의 경우 indexAsync 로 비동기 요청하였지만 FASTCAT과는 다르게 ElasticSearch의 경우 bulk index 로 처리되는 게 아니다보니 정상적인 테스트를 진행할 수가 없었습니다
- py 20/07/09 05:22:05 INFO SecurityManager: Changing view acls to: hadoop 20/07/09 05:22:05 INFO SecurityManager: Changing modify acls to: hadoop 20/07/09 05:22:05 INFO SecurityManager: Changing view acls groups to: 20/07/09 05:22:05 INFO SecurityManager: Changing modify acls groups to: 20/07/09 05:22:05 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); groups with view permissions: Set(); users with modify permissions: Set(hadoop); groups with modify permissions: Set() 20/07/09 05:22:05 INFO Utils: Successfully started service 'sparkDriver' on port 44467
- zip 20/07/09 05:22:14 INFO SecurityManager: Changing view acls to: hadoop 20/07/09 05:22:14 INFO SecurityManager: Changing modify acls to: hadoop 20/07/09 05:22:14 INFO SecurityManager: Changing view acls groups to: 20/07/09 05:22:14 INFO SecurityManager: Changing modify acls groups to: 20/07/09 05:22:14 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); groups with view permissions: Set(); users with modify permissions: Set(hadoop); groups with modify permissions: Set() 20/07/09 05:22:15 INFO Client: Submitting application application_1594271975987_0001 to ResourceManager 20/07/09 05:22:16 INFO YarnClientImpl: Submitted application application_1594271975987_0001 20/07/09 05:22:16 INFO SchedulerExtensionServices: Starting Yarn extension services with app application_1594271975987_0001 and attemptId None 20/07/09 05:22:17 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:17 INFO Client: client token: N/A diagnostics: AM container is launched
- internal:20888/proxy/application_1594271975987_0001/ user: hadoop 20/07/09 05:22:18 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:19 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:20 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:21 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:22 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:23 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:24 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:25 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:26 INFO Client: Application report for application_1594271975987_0001 (state: ACCEPTED) 20/07/09 05:22:27 INFO YarnClientSchedulerBackend: Add WebUI Filter
- EMR노트북은 이미 생성된 EMR클러스터를 활용할 수 있게 만든 주피터 노트북입니다
- Spark 및 Livy를 실행하는 Amazon EMR 클러스터에 노트북을 생성하고 연결합니다
- 노트북 위치는 EMR로 해도 되지만 S3 버켓으로 설정할수도 있습니다
- 문제 1번 LG CNS RPA 는 급여 이체 담당자의 마우스 클릭 한번 필요 없이 위 업무를 대신 수행합니다
- 개인정보는 당첨자 확인 및 배송 정보 등으로만 사용되며 본 이벤트 외에 다른 용도로 사용되지 않습니다
- * 해당 콘텐츠는 저작권법에 의해 보호받는 저작물로 LG CNS 블로그에 저작권이 있습니다
- Recover your password
- A password will be e-mailed to you