Hadoop生态常见端口

在学习过程中遇到了一些组件，这里将他们的端口号和对应的功能记录下来，将来可能会用得到。

组件	节点	默认端口	配置	用途
HDFS	DataNode	50010	dfs.datanode.address	数据传输
HDFS	DataNode	50075	dfs.datanode.http.address	http服务
HDFS	DataNode	50475	dfs.datanode.https.address	https服务
HDFS	DataNode	50020	dfs.datanode.ipc.address	ipc服务
HDFS	NameNode	50070	dfs.namenode.http-address	http服务
HDFS	NameNode	50470	dfs.namenode.https-address	https服务
HDFS	NameNode	8020	fs.defaultFS	RPC端口，用于获取文件系统metadata信息
HDFS	journalnode	8485	dfs.journalnode.rpc-address	RPC服务
HDFS	journalnode	8480	dfs.journalnode.http-address	HTTP服务
HDFS	ZKFC	8019	dfs.ha.zkfc.port	用于NN HA
YARN	ResourceManager	8030	yarn.resourcemanager.scheduler.address	scheduler组件的IPC端口
YARN	ResourceManager	8031	yarn.resourcemanager.resource-tracker.address	IPC
YARN	ResourceManager	8032	yarn.resourcemanager.address	RM的applications manager(ASM)端口
YARN	ResourceManager	8033	yarn.resourcemanager.admin.address	IPC
YARN	ResourceManager	8088	yarn.resourcemanager.webapp.address	http服务
YARN	NodeManager	8040	yarn.nodemanager.localizer.address	localizer IPC
YARN	NodeManager	8041	yarn.nodemanager.address	NM中container manager的端口
YARN	NodeManager	8042	yarn.nodemanager.webapp.address	http服务端口
YARN	JobHistory Server	10020	mapreduce.jobhistory.address	IPC
YARN	JobHistory Server	19888	mapreduce.jobhistory.webapp.address	http服务端口
HBase	Master	16000	hbase.master.port	IPC
HBase	Master	16010	hbase.master.info.port	http服务端口
HBase	RegionServer	16020	hbase.regionserver.port	IPC
HBase	RegionServer	16030	hbase.regionserver.info.port	http服务端口
HBase	HQuorumPeer	2181	hbase.zookeeper.property.clientPort	HBase内置ZK集群端口
HBase	HQuorumPeer	2888	hbase.zookeeper.peerport	HBase内置ZK集群端口
HBase	HQuorumPeer	3888	hbase.zookeeper.leaderport	HBase内置ZK集群端口
Hive	Metastore	9083	export PORT=	hive-metastore中定义默认端口
Hive	HiveServer	10000	export HIVE_SERVER2_THRIFT_PORT=	hive-env.sh中定义默认端口
ZK	Server	2181	clientPort=	对客户端提供服务的端口
ZK	Server	2888	server.x=	follower用来连接到leader，只在leader上监听该端口
ZK	Server	3888	server.x=	用于leader选举的。只在electionAlg是1,2或3(默认)时需要
Storm	Zookeeper	2181	storm.zookeeper.port	Nimbus, Supervisors, and Worker processes
Storm	Nimbus	6627	nimbus.thrift.port	Storm clients, Supervisors, and UI
Storm	UI	8080	ui.port	Client Web Browsers
Storm	Logviewer	8000	logviewer.port	Client Web Browsers
Storm	DRPC	3772	drpc.port	External DRPC Clients
Storm	DRPC	3773	``drpc.invocations.port`	Worker Processes
Storm	DRPC	3774	drpc.http.port	External HTTP DRPC Clients
Storm	WorkerProcesses	670 {0,1,2,3}	supervisor.slots.ports	Worker Processes
Spark	UI	4040	spark.ui.port	应用程序仪表板的端口，显示内存和工作负载数据
Spark	shuffle service	7337	spark.shuffle.service.port	将运行外部shuffle服务的端口

参考文献

https://hadoop.apache.org/docs/r2.6.0/
https://hbase.apache.org/book.html
https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-ConfigurationManagementOverview
https://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html#sc_zkMulitServerSetup
http://storm.apache.org/releases/1.0.6/SECURITY.html
http://spark.apache.org/docs/2.0.0/configuration.html