刘明帅
热爱生活!
刘明帅
Hadoop生态常见端口
Hadoop生态常见端口
组件节点默认端口配置用途
HDFSDataNode50010dfs.datanode.address数据传输
HDFSDataNode50075dfs.datanode.http.addresshttp服务
HDFSDataNode50475dfs.datanode.https.addresshttps服务
HDFSDataNode50020dfs.datanode.ipc.addressipc服务
HDFSNameNode50070dfs.namenode.http-addresshttp服务
HDFSNameNode50470dfs.namenode.https-addresshttps服务
HDFSNameNode8020fs.defaultFSRPC端口,用于获取文件系统metadata信息
HDFSjournalnode8485dfs.journalnode.rpc-addressRPC服务
HDFSjournalnode8480dfs.journalnode.http-addressHTTP服务
HDFSZKFC8019dfs.ha.zkfc.port用于NN HA
YARNResourceManager8030yarn.resourcemanager.scheduler.addressscheduler组件的IPC端口
YARNResourceManager8031yarn.resourcemanager.resource-tracker.addressIPC
YARNResourceManager8032yarn.resourcemanager.addressRM的applications manager(ASM)端口
YARNResourceManager8033yarn.resourcemanager.admin.addressIPC
YARNResourceManager8088yarn.resourcemanager.webapp.addresshttp服务
YARNNodeManager8040yarn.nodemanager.localizer.addresslocalizer IPC
YARNNodeManager8041yarn.nodemanager.addressNM中container manager的端口
YARNNodeManager8042yarn.nodemanager.webapp.addresshttp服务端口
YARNJobHistory Server10020mapreduce.jobhistory.addressIPC
YARNJobHistory Server19888mapreduce.jobhistory.webapp.addresshttp服务端口
HBaseMaster16000hbase.master.portIPC
HBaseMaster16010hbase.master.info.porthttp服务端口
HBaseRegionServer16020hbase.regionserver.portIPC
HBaseRegionServer16030hbase.regionserver.info.porthttp服务端口
HBaseHQuorumPeer2181hbase.zookeeper.property.clientPortHBase内置ZK集群端口
HBaseHQuorumPeer2888hbase.zookeeper.peerportHBase内置ZK集群端口
HBaseHQuorumPeer3888hbase.zookeeper.leaderportHBase内置ZK集群端口
HiveMetastore9083export PORT=hive-metastore中定义默认端口
HiveHiveServer10000export HIVE_SERVER2_THRIFT_PORT=hive-env.sh中定义默认端口
ZKServer2181clientPort=对客户端提供服务的端口
ZKServer2888server.x=follower用来连接到leader,只在leader上监听该端口
ZKServer3888server.x=用于leader选举的。只在electionAlg是1,2或3(默认)时需要
StormZookeeper2181storm.zookeeper.portNimbus, Supervisors, and Worker processes
StormNimbus6627nimbus.thrift.portStorm clients, Supervisors, and UI
StormUI8080ui.portClient Web Browsers
StormLogviewer8000logviewer.portClient Web Browsers
StormDRPC3772drpc.portExternal DRPC Clients
StormDRPC3773`drpc.invocations.portWorker Processes
StormDRPC3774drpc.http.portExternal HTTP DRPC Clients
StormWorkerProcesses670 {0,1,2,3}supervisor.slots.portsWorker Processes
SparkUI4040spark.ui.port应用程序仪表板的端口,显示内存和工作负载数据
Sparkshuffle service7337spark.shuffle.service.port将运行外部shuffle服务的端口

参考文献

https://hadoop.apache.org/docs/r2.6.0/

https://hbase.apache.org/book.html

https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-ConfigurationManagementOverview

https://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html#sc_zkMulitServerSetup

http://storm.apache.org/releases/1.0.6/SECURITY.html

http://spark.apache.org/docs/2.0.0/configuration.html

文章链接: https://lmshuai.com/archives/72
版权声明: 本博客所有文章除特别声明外,均采用 CC BY-NC-SA 4.0 许可协议。转载请注明出处!

推荐文章

发表评论

textsms
account_circle
email

刘明帅

Hadoop生态常见端口
组件节点默认端口配置用途HDFSDataNode50010dfs.datanode.address数据传输HDFSDataNode50075dfs.datanode.http.addresshttp服务HDFSDataNode50475dfs.datanode.https.addresshttps服务HDF…
扫描二维码继续阅读
2019-05-22