trafodion-general team mailing list archive

["Birdsall, Dave" <dave.birdsall@xxxxxx>]

Hi Jin,

Some folks are taking a look at this and hope to have advice shortly. Stay tuned.

Dave

-----Original Message-----
From: Trafodion-general [mailto:trafodion-general-bounces+dave.birdsall=hp.com@xxxxxxxxxxxxxxxxxxx] On Behalf Of Chew, Tung Jin
Sent: Friday, July 11, 2014 11:06 AM
To: trafodion-general@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Trafodion-general] Trafodion 'traf_cloudera_mods' installer issues

Having edited the URLs so that they'll point at valid services and removed Java 6, the cluster does reboot with the extra Trafodian jars on the classpath. 

Unfortunately, I'm running into some problems with running the trafodion_installer step as the trafodion user. When run with
  su trafodion
  ./trafodion_installer --dcs_servers 2 --init_trafodion I get an error
  ***INFO: Starting Trafodion installer (2014-07-11-12-14-10)
  ***ERROR: Specified SQ config file cannot be found (/home/trafodion/sqconfig).
There isn't an sqconfig file, since one isn't specified from the command line. 

I think the script is meant to use an autogenerated ~trafodion/sqconfig if there's multiple nodes, or the one in ~trafodion/trafodion_build.tgz 's sql/scripts/sqconfig if there's one node; but the script incorrectly sets a default value to SQCONFIG in
  typeset SQCONFIG="$HOME/sqconfig"
so the defaults don't get used. 

If I edit trafodion_installer to clear the default value, e.g. 
  set SQCONFIG="" 
then it continues running the rest of the script, but fails with the following error:
  ***INFO: Starting Trafodion installer (2014-07-11-15-28-13)
  ***INFO: untarring build file /home/trafodion/trafodion_build.tgz to /home/trafodion/trafodion
  ***INFO: modifying .bashrc to set SQ_HOME, TOOLSDIR, MY_NODES and NODE_LIST
  ***INFO: Modifying sqenvcom.sh for Cloudera distro
  The environment changed from a previous execution of this script.
  This is not supported. To change environments, do the following:
    sqstop
    <make any changes, e.g. update Hadoop, HBase, MySQL>
    start a new shell and source in sqenv.sh
    rm $MY_SQROOT/etc/ms.env
    sqgen
    start a new shell and source in sqenv.sh
    sqstart
  ***INFO: modifying /home/trafodion/trafodion/conf/hbase-site.xml to add ZooKeeper Quorum
  ***INFO: Creating /home/trafodion/trafodion directory on all nodes
  pdsh@hadoop-trafodion: no remote hosts specified
  ***INFO: starting sqgen

  Could not parse /home/trafodion/trafodion/sql/scripts/sqconfig file.
  Please ensure sqenv.sh has been sourced and the sqconfig file is valid.  Then, re-run sqgen.

  ***ERROR: sqgen failed with RC=1. Check install log file for details.

Does anyone have any suggestions on what to do next? I've tried sourcing the sqenv.sh file directly, then running the sqgen script, but it fails with the same error. I can't seem to find an error log for sqgen either. 

Thanks,
Jin

Tung Jin Chew  |  Software Developer, Autonomy  |  HP Software  |  tung-jin.chew@xxxxxx

________________________________________
From: Trafodion-general [trafodion-general-bounces+tung-jin.chew=hp.com@xxxxxxxxxxxxxxxxxxx] on behalf of Chew, Tung Jin
Sent: 11 July 2014 13:15
To: trafodion-general@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Trafodion-general] Trafodion 'traf_cloudera_mods' installer       issues

`pdsh` should also probably be added to the list of required packages in
  package_list="java-1.7.0-openjdk-devel qpid-cpp-client perl sqlite "
since it's used by the installer.

Cloudera's installer also seems to install Java 6, which was used in preference over Java 7 by the servers, causing exceptions when loading the Java-7-compiled TransactionalRegionServer on HBase restart:
  Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/hadoop/hbase/regionserver/transactional/TransactionalRegionServer : Unsupported major.minor version 51.0

Removing it seems to make Cloudera use Java 7 instead.
  yum remove jdk-1.6.0_31-fcs.x86_64

Thanks,
Jin

Tung Jin Chew  |  Software Developer, Autonomy  |  HP Software  |  tung-jin.chew@xxxxxx

________________________________________
From: Trafodion-general [trafodion-general-bounces+tung-jin.chew=hp.com@xxxxxxxxxxxxxxxxxxx] on behalf of Chew, Tung Jin
Sent: 11 July 2014 10:34
To: trafodion-general@xxxxxxxxxxxxxxxxxxx
Subject: [Trafodion-general] Trafodion 'traf_cloudera_mods' installer issues

Hi,

I'm testing the Trafodion 0.8.2 installer using the instructions at https://wiki.trafodion.org/wiki/index.php/Trafodion_Installation#STEP_START_INSTALL on CentOS 6.5 with CDH 4.5.0.

When I run the traf_cloudera_mods script:
  [root@hadoop-trafodion installer]# ./traf_cloudera_mods --trafodion_build /root/trafodion-0.8.2/trafodion_server-0.8.0.tgz
it succeeds; but I think it's failing on some of the curl commands. The script assumes that the HDFS service is called 'hdfs1', e.g.
  http://$CLOUDERA_MANAGER_URL/api/v1/clusters/$CLUSTER_NAME/services/hdfs1/config<https://webmail.hp.com/owa/UrlBlockedError.aspx>

but the current Cloudera installer seems to have renamed it to just 'hdfs', e.g. this fails:
  root@hadoop-trafodion ~]# curl -u admin:admin localhost:7180/api/v1/clusters/hadoop-trafodion.autonomy.com/services/hdfs1/config
{
  "message" : "Service 'hdfs1' not found in cluster 'hadoop-trafodion.autonomy.com'."
}
while the service name 'hdfs' works
  [root@hadoop-trafodion ~]# curl -s -u admin:admin localhost:7180/api/v1/clusters/hadoop-trafodion.autonomy.com/services/hdfs/config | head {
  "roleTypeConfigs" : [ {
    "roleType" : "DATANODE",
    "items" : [ {
      "name" : "datanode_java_heapsize",
      "value" : "57671680"
    }, {
      "name" : "dfs_data_dir_list",
      "value" : "/dfs/dn"
    }, {
    ...

The name change also applies to other services; e.g. the UI calls it 'hbase' now as in the attached screenshot, as opposed to 'hbase1' in https://wiki.trafodion.org/wiki/index.php/File:RemoveRegionServer2.png.

I think that means that some of the config changes it's trying to apply won't be applied?

As an aside, should the  '--trafodion_build' option default to trafodion_server-0.8.*.tgz instead of the current trafodion_build.tgz? It wasn't clear which of the 3 .tgz files it wanted.

Also, it might be worth mentioning in the wiki that the EPEL repository needs to be added to CentOS for the 'protobuf' dependency to be available.

Thanks,
Jin

Tung Jin Chew  |  Software Developer, Autonomy  |  HP Software  |  tung-jin.chew@xxxxxx<mailto:tung-jin.chew@xxxxxx><mailto:daniel.lau@xxxxxx>

--
Mailing list: https://launchpad.net/~trafodion-general
Post to     : trafodion-general@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~trafodion-general
More help   : https://help.launchpad.net/ListHelp

--
Mailing list: https://launchpad.net/~trafodion-general
Post to     : trafodion-general@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~trafodion-general
More help   : https://help.launchpad.net/ListHelp