有 Java 编程相关的问题?

你可以在下面搜索框中键入要查询的问题!

通过java客户端连接到hbase 1.0.3的数据库连接卡在zookeeper上。ClientCnxn:在服务器上完成会话建立

我一直坚持通过简单的java客户端连接到hbase 1.0.3。 该程序挂起于:

[main] zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=90000 watcher=hconnection-0x1e67b8720x0, quorum=127.0.0.1:2181, baseZNode=/hbaseenter code here
[main-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session
[main-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x153d8383c530008, negotiated timeout = 40000

代码非常简单:

import java.io.IOException;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.TableName;
import org.apache.hadoop.hbase.client.Connection;
import org.apache.hadoop.hbase.client.ConnectionFactory;
import org.apache.hadoop.hbase.client.Result;
import org.apache.hadoop.hbase.client.ResultScanner;
import org.apache.hadoop.hbase.client.Scan;
import org.apache.hadoop.hbase.client.Table;

public class ScanAllTables {

public static void main(String args[]) throws IOException{

    // Instantiating Configuration class
    Configuration config = HBaseConfiguration.create();

    System.out.println(config.get("hbase.rootdir"));
    System.out.println(config.get("hbase.zookeeper.property.dataDir"));
    System.out.println(config.get("hbase.zookeeper.quorum"));
    System.out.println(config.get("hbase.zookeeper.property.clientPort"));

    Connection connection = ConnectionFactory.createConnection(config);

    //System.out.println(connection);

    // Instantiating Table class
    Table  table = connection.getTable(TableName.valueOf(HBaseTables.APPLICATION_TRACE_INDEX));

    //System.out.println(table.getName());

    // Instantiating the Scan class
    Scan scan = new Scan();

     // Scanning the required columns
    //scan.addFamily(HBaseTables.APPLICATION_TRACE_INDEX_CF_TRACE);
    //scan.setId("ApplicationTraceIndexScan");

    // Getting the scan result
    ResultScanner scanner = table.getScanner(scan);

    // Reading values from scan result
    for (Result result = scanner.next(); result != null; result = scanner.next()) {
        System.out.println("Found row : " + result);
    }


    //closing the scanner
    scanner.close();

    table.close();
        connection.close();
     }

}

我使用的罐子是:

commons-collections-3.2.1.jar
commons-configuration-1.6.jar
commons-lang-2.6.jar
commons-logging-1.2.jar
guava-12.0.1.jar
hadoop-auth-2.5.1.jar
hadoop-client-2.5.1.jar
hadoop-common-2.5.1.jar
hbase-client-1.0.3.jar
hbase-common-1.0.3.jar
hbase-hadoop-compat-1.0.3.jar
hbase-hadoop2-compat-1.0.3.jar
hbase-it-1.0.3.jar
hbase-protocol-1.0.3.jar
hbase-resource-bundle-1.0.3.jar
hbase-rest-1.0.3.jar
htrace-core-3.0.4.jar
htrace-core-3.1.0-incubating.jar
log4j-1.2.17.jar
netty-3.2.4.Final.jar
netty-all-4.0.23.Final.jar
protobuf-java-2.5.0.jar
slf4j-api-1.7.7.jar
slf4j-log4j12-1.7.7.jar
zookeeper-3.4.6.jar

我的hbase网站。xml是

<configuration>
  <property>
    <name>hbase.rootdir</name>
    <value>file:///path/to/data/hbase</value>
  </property>
  <property>
    <name>hbase.zookeeper.property.dataDir</name>
    <value>file:///path/to/data/zookeeper</value>
  </property>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>127.0.0.1</value>
  </property>
</configuration>

在我的主机中,我有以下条目: 127.0.0.1本地主机。localdomain localhost Sachin PC

在hbase区域中,服务器也有本地主机 我已经尝试了很多hbase选项。动物园管理员。quorum与localhost、Sachin PC一样,但都不起作用

还要注意,我使用的JAR在hbase库中的版本相同

我只是不知道是什么原因导致了扫描这个简单代码的失败

注意,代码在ResultScanner scanner=table行停止。getScanner(扫描); 所以连接正在发生,但它没有得到任何数据

请帮忙

谢谢 萨钦

附言:

    DEBUG [hconnection-0x1e67b872-shared--pool1-t1] ipc.AbstractRpcClient: Use SIMPLE authentication for service ClientService, sasl=false                             
    DEBUG [hconnection-0x1e67b872-shared--pool1-t1] ipc.AbstractRpcClient: Connecting to Sachin-PC/127.0.0.1:55161                                                     
    DEBUG [hconnection-0x1e67b872-shared--pool1-t1] ipc.AbstractRpcClient: Use SIMPLE authentication for service ClientService, sasl=false                             
    DEBUG [hconnection-0x1e67b872-shared--pool1-t1] ipc.AbstractRpcClient: Not trying to connect to Sachin-PC/127.0.0.1:55161 this server is in the failed servers list

请查看以下附加日志: 正如我们所看到的,连接发生了,区域位置细节也被获取了。 但是,当它试图连接到该区域以实际获取表扫描详细信息时,我们会得到socket关闭错误,然后将其添加到失败的服务器列表中。这个过程一次又一次地重复,因此这个过程被卡住了

[main-EventThread] zookeeper.ZooKeeperWatcher: hconnection-0x1e67b872-0x153e135af570008 connected

[main] client.ZooKeeperRegistry: Looking up meta region location in ZK, connection=org.apache.hadoop.hbase.client.ZooKeeperRegistry@69b794e2

[main] client.ZooKeeperRegistry: Looked up meta region location, connection=org.apache.hadoop.hbase.client.ZooKeeperRegistry@69b794e2; serverName=sachin-pc,55964,1459772310378
[main] client.MetaCache: Cached location: [region=hbase:meta,,1.1588230740, hostname=sachin-pc,55964,1459772310378, seqNum=0]

[hconnection-0x1e67b872-shared--pool1-t1] ipc.AbstractRpcClient: Connecting to Sachin-PC/127.0.0.1:55964

java.net.SocketException: Socket is closed
    at sun.nio.ch.SocketAdaptor.getOutputStream(Unknown Source)
    at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.closeConnection(RpcClientImpl.java:429)
    at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.handleConnectionFailure(RpcClientImpl.java:477)


java.net.SocketException: Socket is closed
    at sun.nio.ch.SocketAdaptor.getInputStream(Unknown Source)
    at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.closeConnection(RpcClientImpl.java:436)
    at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.handleConnectionFailure(RpcClientImpl.java:477)



[hconnection-0x1e67b872-shared--pool1-t1] ipc.AbstractRpcClient: IPC Client (1890187342) connection to Sachin-PC/127.0.0.1:55964 from Sachin: marking at should close, reason: Connection refused: no further information

共 (1) 个答案

  1. # 1 楼答案

    我解决了这个问题。 区域服务器正在侦听192.168.1.102:55964,而不是127.0.0.1:55964。 192.168.1.102是我机器的IP,Sachin PC是我的机器名

    我的参赛作品是 127.0.0.1本地主机。localdomain localhost Sachin PC

    我从那里移除了Sachin PC,它现在可以工作了。客户端现在连接到192.168.1.102:55964

    然而,我不明白一件事: 在我指定的RegionServer中:127.0.0.1 也在我的hbase网站上。我指定的xml hbase。动物园管理员。法定人数为127.0.0.1

    当我使用netstat时,我看到zookeeper、master、master web UI、region server web UI都在0.0.0.0的监听 然而,regionserver正在监听192.168.1.102,这是我机器的IP地址

    那么为什么regionserver在另一个IP上监听呢

    还有一件事,当我启动hbase时,我没有看到生成任何日志文件。如何指定要生成的日志文件