← Back to team overview

maria-discuss team mailing list archive

How to write streaming data to mariaDB columnStorage efficiently?

 

I just have a try.

CREATE TABLE `robotmetrics2` (
  `robotid` varchar(16) DEFAULT NULL,
  `ts` bigint(20) DEFAULT NULL,
  `xloc` int(11) DEFAULT NULL,
  `yloc` int(11) DEFAULT NULL,
  `velocity` int(11) DEFAULT NULL,
  `angular_velocity` int(11) DEFAULT NULL
) ENGINE=Columnstore DEFAULT CHARSET=utf8


But when i write data to the table with python connector, the qps is only about 10/s. And the cpu is 60%+. 
And it takes a lot of  disk space. Mainly this file: /var/lib/columnstore/data1/versionbuffer.cdf 

Does i do something wrong?

Thanks,
Lei



wanglei2@xxxxxxxxxxxx