monasca team mailing list archive

[Oguz Yarimtepe <oguzyarimtepe@xxxxxxxxx>]

This is what happens

$ sudo service monasca-thresh status
(monasca)oguz@mini-mon:/opt/monasca/hpcloud-mon-monasca-ci-fcb454e/tests/smoke$ 
sudo service monasca-thresh restart
Running: java -client -Dstorm.options= 
-Dstorm.home=/opt/storm/apache-storm-0.9.5 
-Dstorm.log.dir=/opt/storm/apache-storm-0.9.5/logs 
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib 
-Dstorm.conf.file= -cp 
/opt/storm/apache-storm-0.9.5/lib/math.numeric-tower-0.0.1.jar:/opt/storm/apache-storm-0.9.5/lib/commons-lang-2.5.jar:/opt/storm/apache-storm-0.9.5/lib/storm-core-0.9.5.jar:/opt/storm/apache-storm-0.9.5/lib/asm-4.0.jar:/opt/storm/apache-storm-0.9.5/lib/compojure-1.1.3.jar:/opt/storm/apache-storm-0.9.5/lib/core.incubator-0.1.0.jar:/opt/storm/apache-storm-0.9.5/lib/clout-1.0.1.jar:/opt/storm/apache-storm-0.9.5/lib/joda-time-2.0.jar:/opt/storm/apache-storm-0.9.5/lib/snakeyaml-1.11.jar:/opt/storm/apache-storm-0.9.5/lib/disruptor-2.10.1.jar:/opt/storm/apache-storm-0.9.5/lib/jgrapht-core-0.9.0.jar:/opt/storm/apache-storm-0.9.5/lib/minlog-1.2.jar:/opt/storm/apache-storm-0.9.5/lib/tools.macro-0.1.0.jar:/opt/storm/apache-storm-0.9.5/lib/commons-logging-1.1.3.jar:/opt/storm/apache-storm-0.9.5/lib/clojure-1.5.1.jar:/opt/storm/apache-storm-0.9.5/lib/clj-time-0.4.1.jar:/opt/storm/apache-storm-0.9.5/lib/jline-2.11.jar:/opt/storm/apache-storm-0.9.5/lib/commons-codec-1.6.jar:/opt/storm/apache-storm-0.9.5/lib/hiccup-0.3.6.jar:/opt/storm/apache-storm-0.9.5/lib/ring-devel-0.3.11.jar:/opt/storm/apache-storm-0.9.5/lib/slf4j-api-1.7.5.jar:/opt/storm/apache-storm-0.9.5/lib/logback-classic-1.0.13.jar:/opt/storm/apache-storm-0.9.5/lib/jetty-6.1.26.jar:/opt/storm/apache-storm-0.9.5/lib/tools.cli-0.2.4.jar:/opt/storm/apache-storm-0.9.5/lib/commons-exec-1.1.jar:/opt/storm/apache-storm-0.9.5/lib/carbonite-1.4.0.jar:/opt/storm/apache-storm-0.9.5/lib/ring-servlet-0.3.11.jar:/opt/storm/apache-storm-0.9.5/lib/commons-io-2.4.jar:/opt/storm/apache-storm-0.9.5/lib/servlet-api-2.5.jar:/opt/storm/apache-storm-0.9.5/lib/commons-fileupload-1.2.1.jar:/opt/storm/apache-storm-0.9.5/lib/log4j-over-slf4j-1.6.6.jar:/opt/storm/apache-storm-0.9.5/lib/reflectasm-1.07-shaded.jar:/opt/storm/apache-storm-0.9.5/lib/tools.logging-0.2.3.jar:/opt/storm/apache-storm-0.9.5/lib/jetty-util-6.1.26.jar:/opt/storm/apache-storm-0.9.5/lib/chill-java-0.3.5.jar:/opt/storm/apache-storm-0.9.5/lib/ring-jetty-adapter-0.3.11.jar:/opt/storm/apache-storm-0.9.5/lib/ring-core-1.1.5.jar:/opt/storm/apache-storm-0.9.5/lib/objenesis-1.2.jar:/opt/storm/apache-storm-0.9.5/lib/kryo-2.21.jar:/opt/storm/apache-storm-0.9.5/lib/json-simple-1.1.jar:/opt/storm/apache-storm-0.9.5/lib/clj-stacktrace-0.2.2.jar:/opt/storm/apache-storm-0.9.5/lib/logback-core-1.0.13.jar:/opt/storm/apache-storm-0.9.5/conf:/opt/storm/apache-storm-0.9.5/bin 
backtype.storm.command.kill_topology thresh-cluster
2083 [main] INFO  backtype.storm.thrift - Connecting to Nimbus at 
10.101.31.62:6627
Exception in thread "main" NotAliveException(msg:thresh-cluster is not 
alive)
    at 
backtype.storm.generated.Nimbus$killTopologyWithOpts_result.read(Nimbus.java:4845)
    at 
org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:78)
    at 
backtype.storm.generated.Nimbus$Client.recv_killTopologyWithOpts(Nimbus.java:242)
    at 
backtype.storm.generated.Nimbus$Client.killTopologyWithOpts(Nimbus.java:228)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
    at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
    at 
backtype.storm.command.kill_topology$_main.doInvoke(kill_topology.clj:27)
    at clojure.lang.RestFn.applyTo(RestFn.java:137)
    at backtype.storm.command.kill_topology.main(Unknown Source)
....

466  [main] INFO  monasca.thresh.ThresholdingEngine - -------- Version 
Information --------
470  [main] INFO  monasca.thresh.ThresholdingEngine - 
monasca-thresh-1.1.0-SNAPSHOT-2015-09-29T17:02:12-7a595c
471  [main] INFO  monasca.thresh.ThresholdingEngine - Instantiating 
ThresholdingEngine with config file: /etc/monasca/thresh-config.yml, 
topology: thresh-cluster
1210 [main] INFO  org.hibernate.validator.internal.util.Version - 
HV000001: Hibernate Validator 5.2.1.Final
1708 [main] INFO  monasca.thresh.ThresholdingEngine - local set to false
2159 [main] INFO monasca.thresh.infrastructure.thresholding.MetricSpout 
- Created
2277 [main] INFO monasca.thresh.infrastructure.thresholding.EventSpout - 
EventSpout created
2871 [main] INFO  monasca.thresh.ThresholdingEngine - submitting 
topology thresh-cluster to non-local storm cluster
2982 [main] INFO  backtype.storm.StormSubmitter - Jar not uploaded to 
master yet. Submitting jar...
2989 [main] INFO  backtype.storm.StormSubmitter - Uploading topology jar 
/opt/monasca/monasca-thresh.jar to assigned location: 
/var/storm/nimbus/inbox/stormjar-c7798d97-c132-4e26-991c-a77c763c7872.jar
3423 [main] INFO  backtype.storm.StormSubmitter - Successfully uploaded 
topology jar to assigned location: 
/var/storm/nimbus/inbox/stormjar-c7798d97-c132-4e26-991c-a77c763c7872.jar
3423 [main] INFO  backtype.storm.StormSubmitter - Submitting topology 
thresh-cluster in distributed mode with conf 
{"topology.workers":12,"topology.acker.executors":12,"topology.metrics.consumer.register":[{"argument":{"metrics.statsd.host":"localhost","metrics.statsd.dimensions":{"service":"monitoring","component":"storm"},"metrics.statsd.port":8125},"parallelism.hint":2,"class":"monasca.thresh.utils.StatsdMetricConsumer"}],"topology.kryo.register":["monasca.thresh.domain.model.SubAlarm","monasca.thresh.domain.model.SubExpression"]}
3754 [main] INFO  backtype.storm.StormSubmitter - Finished submitting 
topology: thresh-cluster


$ sudo rm /var/storm/nimbus/inbox/*.jar
$ sudo service monasca-thresh status
thresh-cluster       ACTIVE     86         2            23
(monasca)oguz@mini-mon:/var/storm/nimbus/inbox$ sudo service 
monasca-thresh status

is empty a the second run.

I have a remote vm for mini-mon and just runnign monasca-agent, ui and 
keystone roles on my controller.

any idea?

On 01/04/2016 11:14 PM, O Neill, Cindy wrote:
> Hi Oguz,
>
> You could try restarting the monasca-thresh in both 'mini-mon' and 
> ‘devstack' vagrant servers ('vagrant ssh mini-mon', 'vagrant ssh 
> devstack' to get there).  Monasca-thresh uploads the thresh topology 
> to storm.
> You can see if it is not running by doing a : ‘sudo service 
> monasca-thresh status’
> If it is not running do a 'sudo service monasca-thresh restart'
>
> You can also check to see if these are running:
> sudo service storm-nimbus status
> sudo service storm-supervisor status
>
> If either of those show they aren’t running, start them. You might 
> have to restart supervisor if it is running and nimbus isn’t.
>
> Thanks,
> Cindy