筹建hadoop环境
搭建hadoop环境
因为想在windows平台下开发Hadoop,所以安装了一个cygwin。cygwin是一个可以在windows上模拟linux运行环境的软件,使用它的客户端可以方便的在windows上进行Linux平台的操作。下面总结一下中间遇到的问题和解决方法:
首先要下载一个cygwin的安装程序,下载安装程序,下载地址为: http://www.cygwin.com/setup.exe 选择必须安装的包,根据实践有如下包必须选择安 装,否则很可能cygwin安装失败!
Net Category下的OpenSSL,OpenSSH;
Base Category下的sed;
Editors Category下的vim,Emacs;
Devel Category下的subversion,binutils,gcc,gcc-mingw,gdb
安装完成之后,就要配置host并且安装sshd服务了,这里要强调一下sshd服务,很多网上的安装教程没有提到如何安装,其实就是在运行ssh-host-config命令之后安装。里面有这个选项,按照如下操作:
必须要以管理员身份运行cygwin,否则会安装失败,然后运行命令ssh-host-config。
在计算机管理里面启动sshd服务。
运行ssh localhost验证是否ssh安装成功,但是有一个前提条件就是你的localhost用户必须设置了用户名和密码,所以你的PC机需要设置一个密码,否则不可以远程登录。 (收起)
因为想在windows平台下开发Hadoop,所以安装了一个cygwin。cygwin是一个可以在windows上模拟linux运行环境的软件,使用它的客户端可以方便的在windows上进行Linux平台的操作。下面总结一下中间遇到的问题和解决方法:
首先要下载一个cygwin的安装程序,下载安装程序,下载地址为: http://www.cygwin.com/setup.exe 选择必须安装的包,根据实践有如下包必须选择安 装,否则很可能cygwin安装失败!
Net Category下的OpenSSL,OpenSSH;
Base Category下的sed;
Editors Category下的vim,Emacs;
Devel Category下的subversion,binutils,gcc,gcc-mingw,gdb
安装完成之后,就要配置host并且安装sshd服务了,这里要强调一下sshd服务,很多网上的安装教程没有提到如何安装,其实就是在运行ssh-host-config命令之后安装。里面有这个选项,按照如下操作:
必须要以管理员身份运行cygwin,否则会安装失败,然后运行命令ssh-host-config。
$ ssh-host-config *** Info: Generating /etc/ssh_host_key unknown key type *** Info: Generating /etc/ssh_host_rsa_key unknown key type *** Info: Generating /etc/ssh_host_dsa_key unknown key type *** Query: Overwrite existing /etc/ssh_config file? (yes/no) yes *** Info: Creating default /etc/ssh_config file *** Query: Overwrite existing /etc/sshd_config file? (yes/no) yes *** Info: Creating default /etc/sshd_config file *** Info: Privilege separation is set to yes by default since OpenSSH 3.3. *** Info: However, this requires a non-privileged account called 'sshd'. *** Info: For more info on privilege separation read /usr/share/doc/openss ME.privsep. *** Query: Should privilege separation be used? (yes/no) no *** Info: Updating /etc/sshd_config file mount: invalid option - 'text,posix=0,noacl' grep: /ssh-host-config.7180/services: No such file or directory grep: /ssh-host-config.7180/services: No such file or directory /usr/bin/ssh-host-config: line 119: /ssh-host-config.7180/services: No suc or directory *** Warning: Adding ssh to D:umount: /ssh-host-config.7180: Invalid argume *** Warning: The following functions require administrator privileges! *** Query: Do you want to install sshd as a service? *** Query: (Say "no" if it is already installed as a service) (yes/no) yes *** Query: Enter the value of CYGWIN for the daemon: [] ntsec *** Info: On Windows Server 2003, Windows Vista, and above, the *** Info: SYSTEM account cannot setuid to other users -- a capability *** Info: sshd requires. You need to have or to create a privileged *** Info: account. This script will help you do so. *** Info: You appear to be running Windows 2003 Server or later. On 2003 *** Info: and later systems, it's not possible to use the LocalSystem *** Info: account for services that can change the user id without an *** Info: explicit password (such as passwordless logins [e.g. public key *** Info: authentication] via sshd). *** Info: If you want to enable that functionality, it's required to creat *** Info: a new account with special privileges (unless a similar account *** Info: already exists). This account is then used to run these special *** Info: servers. *** Info: Note that creating a new user requires that the current account *** Info: have Administrator privileges itself. *** Info: No privileged account could be found. *** Info: This script plans to use 'cyg_server'. *** Info: 'cyg_server' will only be used by registered services. *** Query: Do you want to use a different name? (yes/no) no *** Query: Create new privileged user account 'cyg_server'? (yes/no) yes *** Info: Please enter a password for new user cyg_server. Please be sure *** Info: that this password matches the password rules given on your syst *** Info: Entering no password will exit the configuration. *** Query: Please enter the password: *** Query: Reenter: *** Info: User 'cyg_server' has been created with password 'root'. *** Info: If you change the password, please remember also to change the *** Info: password for the installed services which use (or will soon use) *** Info: the 'cyg_server' account. *** Info: Also keep in mind that the user 'cyg_server' needs read permissi *** Info: on all users' relevant files for the services running as 'cyg_se *** Info: In particular, for the sshd server all users' .ssh/authorized_ke *** Info: files must have appropriate permissions to allow public key *** Info: authentication. (Re-)running ssh-user-config for each user will *** Info: these permissions corrently. [Similary restrictions apply, for *** Info: instance, for .rhosts files if the rshd server is running, etc]. *** Info: The sshd service has been installed under the 'cyg_server' *** Info: account. To start the service now, call `net start sshd' or *** Info: `cygrunsrv -S sshd'. Otherwise, it will start automatically *** Info: after the next reboot. *** Info: Host configuration finished. Have fun!
在计算机管理里面启动sshd服务。
运行ssh localhost验证是否ssh安装成功,但是有一个前提条件就是你的localhost用户必须设置了用户名和密码,所以你的PC机需要设置一个密码,否则不可以远程登录。 (收起)