hdfs3 Hadoop 1.2.1 Installation & Troubleshooting Installation Check the firewalls among servers. ( Recommended to open all ports among servers )Create same account( TEST_ACCOUNT ) to all servers.Create public key of TEST_ACCOUNT for each server. ( ssh-keygen )Authorize public key of TEST_ACCOUNT in master server to each slave server TEST_ACCOUNT so that master account can access each slave servers through ssh( FILE : $HOME/.ssh/authorized_keys.. 2014. 2. 3. HDFS Errors Master Error Message1234567891011121314152013-07-15 13:36:59,258 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:cse cause:java.io.IOException: File /tmp/hadoop-cse/mapred/system/jobtracker.info could only be replicated to 0 nodes, instead of 12013-07-15 13:36:59,259 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 9000, call addBlock(/tmp/hadoop-cs.. 2013. 7. 15. Summary on HDFS (Cont.) 분산 처리 관련 업무 중 HDFS 관련 조사가 필요하여 관련 분석 내용을 참고차 기록한다. HDFS supports following read/write policiesreadrandom readsequential readwritesequential writeBlock size, the number of replica can be set for each file. 2013. 7. 9. 이전 1 다음