graphite-dev team mailing list archive

[basketcase <question183344@xxxxxxxxxxxxxxxxxxxxx>]

New question #183344 on Graphite:
https://answers.launchpad.net/graphite/+question/183344

I _think_ my data is in the correct format, in fact I have had one successful import.

but in /listener.log

I have this:

30/12/2011 15:04:10 :: invalid line received from client 127.0.0.1:40247, ignoring
30/12/2011 15:04:10 :: invalid line: 'us.production.mind.requests.total 50301 1301209200\n'
30/12/2011 15:04:20 :: invalid line received from client 127.0.0.1:40247, ignoring
30/12/2011 15:04:20 :: invalid line: 'us.production.mind.requests.total 50301 1301209200\n'
30/12/2011 15:04:30 :: invalid line received from client 127.0.0.1:40247, ignoring
30/12/2011 15:04:30 :: invalid line: 'us.production.mind.requests.total 50301 1301209200\n'
30/12/2011 15:04:40 :: invalid line received from client 127.0.0.1:40247, ignoring
30/12/2011 15:04:40 :: invalid line: 'us.production.mind.requests.total 50301 1301209200\n'
30/12/2011 15:04:50 :: invalid line received from client 127.0.0.1:40247, ignoring
30/12/2011 15:04:50 :: invalid line: 'us.production.mind.requests.total 50301 1301209200\n'

Here is what I'm sending it:

['us.production.mind.requests.total 50301 1301209200\n', 'us.production.mind.requests.total 50348 1301209260\n', 'us.production.mind.requests.total 48798 1301209320\n', 'us.production.mind.requests.total 49425 1301209380\n', 'us.production.mind.requests.total 47898 1301209440\n', 'us.production.mind.requests.total 47486 1301209500\n', 'us.production.mind.requests.total 47378 1301209560\n', 'us.production.mind.requests.total 49055 1301209620\n', 'us.production.mind.requests.total 48428 1301209680\n', 'us.production.mind.requests.total 48662 1301209740\n', 'us.production.mind.requests.total 48693 1301209800\n', 'us.production.mind.requests.total 48561 1301209860\n', 'us.production.mind.requests.total 43759 1301209920\n', 'us.production.mind.requests.total 48766 1301209980\n', 'us.production.mind.requests.total 48537 1301210040\n', 'us.production.mind.requests.total 47781 1301210100\n', 'us.production.mind.requests.total 47507 1301210160\n', 'us.production.mind.requests.total 48723 1301210220\n', 'us.production.mind.requests.total 48498 1301210280\n', 'us.production.mind.requests.total 48767 1301210340\n', 'us.production.mind.requests.total 47721 1301210400\n', 'us.production.mind.requests.total 48451 1301210460\n', 'us.production.mind.requests.total 47160 1301210520\n', 'us.production.mind.requests.total 48488 1301210580\n', 'us.production.mind.requests.total 49108 1301210640\n', 'us.production.mind.requests.total 49271 1301210700\n', 'us.production.mind.requests.total 48328 1301210760\n', 'us.production.mind.requests.total 49832 1301210820\n', 'us.production.mind.requests.total 48314 1301210880\n', 'us.production.mind.requests.total 48750 1301210940\n', 'us.production.mind.requests.total 49387 1301211000\n', 'us.production.mind.requests.total 49573 1301211060\n', 'us.production.mind.requests.total 48919 1301211120\n', 'us.production.mind.requests.total 48267 1301211180\n', 'us.production.mind.requests.total 49387 1301211240\n', 'us.production.mind.requests.total 47475 1301211300\n', 'us.production.mind.requests.total 47814 1301211360\n', 'us.production.mind.requests.total 48651 1301211420\n', 'us.production.mind.requests.total 48456 1301211480\n', 'us.production.mind.requests.total 48831 1301211540\n', 'us.production.mind.requests.total 47082 1301211600\n', 'us.production.mind.requests.total 47483 1301211660\n', 'us.production.mind.requests.total 47864 1301211720\n', 'us.production.mind.requests.total 48184 1301211780\n', 'us.production.mind.requests.total 47350 1301211840\n', 'us.production.mind.requests.total 47480 1301211900\n', 'us.production.mind.requests.total 47509 1301211960\n', 'us.production.mind.requests.total 48019 1301212020\n', 'us.production.mind.requests.total 47866 1301212080\n', 'us.production.mind.requests.total 48035 1301212140\n']

Here is my import/collection script:
#!/usr/bin/python
import fileinput
import glob
import sys
import time
import os
import platform
import subprocess
from socket import socket

CARBON_SERVER = '127.0.0.1'
CARBON_PORT = 2003
delay = 10
sock = socket()
try:
  sock.connect( (CARBON_SERVER,CARBON_PORT) )
except:
  print "Couldn't connect to %(server)s on port %(port)d, is carbon-agent.py running?" % { 'server':CARBON_SERVER, 'port':CARBON_PORT }
  sys.exit(1)

files = glob.glob('/opt/graphite/storage/import_data/*')

while True:
        for file in files:
                with open(file) as f:
                        message = str(f.readlines())
                        print '-' * 80
                        print message
                        print
                        sock.sendall(message)
                        time.sleep(delay)

Python 2.6.6
[root@dhcp-10-100-46-73 bin]# pip freeze
Django==1.3.1
Twisted==11.1.0
distribute==0.6.24
django-tagging==0.3.1
iniparse==0.3.1
mod-python==3.3.1
pycurl==7.19.0
pygpgme==0.1
python-ldap==2.3.10
python-memcached==1.43
simplejson==2.3.1
urlgrabber==3.9.1
virtualenv==1.7
virtualenvwrapper==2.11
whisper==0.9.9
yum-metadata-parser==1.1.2
yum-presto==0.4.4
zope.interface==3.8.0

Any help would be greatly appreciated!!! 


-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.