maria-developers team mailing list archive

[Roberto Spadim <roberto@xxxxxxxxxxxxx>]

ops, linear equation

2014-07-08 15:47 GMT-03:00 Roberto Spadim <roberto@xxxxxxxxxxxxx>:
> going back...
> a1t1 + a2t2 + … + a130t130= ttotal
>
> a1, t1...
>
> a1 is something you don't know
> t1 is the coefficients[i]?
>
> it's a first order equation, right?
>
>
>
> 2014-07-08 15:20 GMT-03:00 Anshu Avinash <anshu.avinash35@xxxxxxxxx>:
>> Hi,
>>
>> The idea is we know the total time the query took, and how many times an
>> operation was performed. For example, consider the case of 'read_time'. We
>> know how many times an index read took place, but don't know how much time
>> does it take to do an index read. By solving these equations, we are trying
>> to find out time for individual operations. coefficients[i].value is `how
>> many time the operation i took place in a single query.`
>>
>> Hope this clears things up.
>>
>> Regards
>> Anshu Avinash
>>
>>
>> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim <roberto@xxxxxxxxxxxxx>
>> wrote:
>>>
>>> just to understand...
>>> --- the solve_equation part, today only used to save information:
>>>   std::ofstream datafile;
>>>   char file_name[100];
>>>   my_snprintf(file_name, 100,
>>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id);
>>>   datafile.open(file_name, std::ios::app);
>>>   for(int i=0; i < MAX_CONSTANTS; i++)
>>>     datafile << coefficients[i].value << " ";
>>>   datafile << total_time << "\n";
>>>   datafile.close();
>>> ----
>>>
>>> the idea is: given a query and some coefficients[i].value, you got
>>> total_time need to execute the query
>>> you want to "train" something to tell you how many time the same query
>>> should execute?
>>> or, what's the "x[i]" variables from your system (hardware/hard
>>> disk/etc), and extend this to others queries?
>>>
>>>
>>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim <roberto@xxxxxxxxxxxxx>:
>>> > =] nice
>>> >
>>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash <anshu.avinash35@xxxxxxxxx>:
>>> >> Hi all,
>>> >>
>>> >> You can download it here
>>> >>
>>> >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing).
>>> >> It is around 26M. I have added the link on blog too.
>>> >>
>>> >> Regards
>>> >> Anshu
>>> >>
>>> >>
>>> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim <roberto@xxxxxxxxxxxxx>
>>> >> wrote:
>>> >>>
>>> >>> could you 'display' the dataset you used with octave?
>>> >>>
>>> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash <anshu.avinash35@xxxxxxxxx>:
>>> >>> > Hi all,
>>> >>> >
>>> >>> > This week's blog post is at:
>>> >>> > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ .
>>> >>> > Sorry
>>> >>> > for
>>> >>> > the delay.
>>> >>> > Suggestions for an approach to solve the system of linear equations
>>> >>> > are
>>> >>> > welcome.
>>> >>> >
>>> >>> > Regards
>>> >>> > Anshu Avinash
>>> >>> >
>>> >>> >
>>> >>> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim
>>> >>> > <roberto@xxxxxxxxxxxxx>
>>> >>> > wrote:
>>> >>> >>
>>> >>> >> " MDEV. "
>>> >>> >> it's nice to put full name (MDEV-350), since google and others
>>> >>> >> search
>>> >>> >> engines help when someone try to find information about mdev 350
>>> >>> >>
>>> >>> >> text is ok :)
>>> >>> >>
>>> >>> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash
>>> >>> >> <anshu.avinash35@xxxxxxxxx>:
>>> >>> >> > Hi,
>>> >>> >> >
>>> >>> >> > Sorry for the confusion, this is the new link:
>>> >>> >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/
>>> >>> >> > Thanks for pointing out.
>>> >>> >> >
>>> >>> >> > Regards
>>> >>> >> > Anshu
>>> >>> >> >
>>> >>> >> >
>>> >>> >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim
>>> >>> >> > <roberto@xxxxxxxxxxxxx>
>>> >>> >> > wrote:
>>> >>> >> >>
>>> >>> >> >> "Sorry this page does not exist =("
>>> >>> >> >>
>>> >>> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash
>>> >>> >> >> <anshu.avinash35@xxxxxxxxx>:
>>> >>> >> >> > Hi all,
>>> >>> >> >> >
>>> >>> >> >> > You can find this week's blog entry at:
>>> >>> >> >> > http://igniting.in/2014/06/23/work-before-mid-term/
>>> >>> >> >> > Suggestions/reviews are welcome.
>>> >>> >> >> >
>>> >>> >> >> > Regards
>>> >>> >> >> > Anshu Avinash
>>> >>> >> >> >
>>> >>> >> >> >
>>> >>> >> >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim
>>> >>> >> >> > <roberto@xxxxxxxxxxxxx>
>>> >>> >> >> > wrote:
>>> >>> >> >> >>
>>> >>> >> >> >> Well i wws reading your posts
>>> >>> >> >> >> Do you need big data to test read and scan times?
>>> >>> >> >> >>
>>> >>> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash
>>> >>> >> >> >> <anshu.avinash35@xxxxxxxxx> escreveu:
>>> >>> >> >> >>
>>> >>> >> >> >>> Hi all,
>>> >>> >> >> >>>
>>> >>> >> >> >>> You can find this week's blog entry at
>>> >>> >> >> >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now
>>> >>> >> >> >>> maintaining the
>>> >>> >> >> >>> code only on github:
>>> >>> >> >> >>> https://github.com/igniting/server/tree/selfTuningOptimizer.
>>> >>> >> >> >>>
>>> >>> >> >> >>> Regards
>>> >>> >> >> >>> Anshu Avinash
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash
>>> >>> >> >> >>> <anshu.avinash35@xxxxxxxxx> wrote:
>>> >>> >> >> >>>
>>> >>> >> >> >>> Hi all,
>>> >>> >> >> >>>
>>> >>> >> >> >>> You can find my this week's blog entry at
>>> >>> >> >> >>> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ . I
>>> >>> >> >> >>> have
>>> >>> >> >> >>> created a
>>> >>> >> >> >>> branch on launchpad for my work:
>>> >>> >> >> >>>
>>> >>> >> >> >>> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211
>>> >>> >> >> >>> .
>>> >>> >> >> >>> You
>>> >>> >> >> >>> can
>>> >>> >> >> >>> give your suggestions/reviews either on this thread or as a
>>> >>> >> >> >>> comment
>>> >>> >> >> >>> on
>>> >>> >> >> >>> the
>>> >>> >> >> >>> blog itself.
>>> >>> >> >> >>>
>>> >>> >> >> >>> Regards
>>> >>> >> >> >>> Anshu Avinash
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim
>>> >>> >> >> >>> <roberto@xxxxxxxxxxxxx>
>>> >>> >> >> >>> wrote:
>>> >>> >> >> >>>
>>> >>> >> >> >>> wow a big work, congratulation guy, i will read part by part
>>> >>> >> >> >>> to
>>> >>> >> >> >>> better
>>> >>> >> >> >>> understand mariadb code
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> 2014-05-19 16:33 GMT-03:00 Anshu Avinash
>>> >>> >> >> >>> <anshu.avinash35@xxxxxxxxx>:
>>> >>> >> >> >>>
>>> >>> >> >> >>> Hi all,
>>> >>> >> >> >>>
>>> >>> >> >> >>> This week's blog entry would get delayed by couple of days.
>>> >>> >> >> >>> I
>>> >>> >> >> >>> have
>>> >>> >> >> >>> started coding though and would like to give heads up on
>>> >>> >> >> >>> what
>>> >>> >> >> >>> I'm
>>> >>> >> >> >>> doing.
>>> >>> >> >> >>>
>>> >>> >> >> >>> I've looked at the diffs for "Cost model project" of mysql:
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596
>>> >>> >> >> >>> and
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7222 .
>>> >>> >> >> >>> These
>>> >>> >> >> >>> give a pretty good idea about what are the hard-coded
>>> >>> >> >> >>> constants
>>> >>> >> >> >>> and
>>> >>> >> >> >>> where
>>> >>> >> >> >>> are they being used.
>>> >>> >> >> >>>
>>> >>> >> >> >>> The idea is to multiply "READ_TIME_FACTOR" and
>>> >>> >> >> >>> "SCAN_TIME_FACTOR"
>>> >>> >> >> >>> to
>>> >>> >> >> >>> the
>>> >>> >> >> >>> values returned by read_time() and scan_time() in handler.h,
>>> >>> >> >> >>> while
>>> >>> >> >> >>> returning. These values would be read from a table in mysql
>>> >>> >> >> >>> db.
>>> >>> >> >> >>> For
>>> >>> >> >> >>> that
>>> >>> >> >> >>> I've looked at sql_statistics.cc. After completing this,
>>> >>> >> >> >>> I'll
>>> >>> >> >> >>> first
>>> >>> >> >> >>> change
>>> >>> >> >> >>> the values of these constants manually and check if the
>>> >>> >> >> >>> better
>>> >>> >> >> >>> or
>>> >>> >> >> >>> worse
>>> >>> >> >> >>> query plans are being selected. I'll first do the last step
>>> >>> >> >> >>> manually,
>>> >>> >> >> >>> to
>>> >>> >> >> >>> check if everything is working as expected and later
>>> >>> >> >> >>> automate
>>> >>> >> >> >>> it.
>>> >>> >> >> >>>
>>> >>> >> >> >>> Regards
>>> >>> >> >> >>> Anshu
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> On Mon, May 12, 2014 at 11:22 AM, Anshu Avinash
>>> >>> >> >> >>> <anshu.avinash35@xxxxxxxxx> wrote:
>>> >>> >> >> >>>
>>> >>> >> >> >>> Hi all,
>>> >>> >> >> >>>
>>> >>> >> >> >>> You can find my blog entry for this week at
>>> >>> >> >> >>> http://igniting.in/gsoc2014/2014/05/11/first-steps/ .
>>> >>> >> >> >>>
>>> >>> >> >> >>> Regards
>>> >>> >> >> >>> Anshu Avinash
>>> >>> >> >> >>>
>>> >>> >> >> >>>
>>> >>> >> >> >>> On Thu, May 8, 2014 at 11:46 PM, Anshu Avinash
>>> >>> >> >> >>> <anshu.avinash35@xxxxxxxxx> wrote:
>>> >>> >> >> >>>
>>> >>> >> >> >>> Hi all,
>>> >>> >> >> >>>
>>> >>> >> >> >>> Sorry for the irregular updates. I had been busy for last
>>> >>> >> >> >>> couple
>>> >>> >> >> >>> of
>>> >>> >> >> >>> days
>>> >>> >> >> >>> and might still be busy for 1-2 days more. I would be
>>> >>> >> >> >>> completely
>>> >>> >> >> >>> free
>>> >>> >> >> >>> starting next week, and would be updating my blog weekly on
>>> >>> >> >> >>> every
>>> >>> >> >> >>> Monday (so
>>> >>> >> >> >>> 1st update would be on May 12). I would also send the link
>>> >>> >> >> >>> of my
>>> >>> >> >> >>> post
>>> >>> >> >> >>> weekly
>>> >>> >> >> >>> on the mailing list.
>>> >>> >> >> >>>
>>> >>> >> >> >>> As discussed on irc, I started to explore the pair of
>>> >>> >> >> >>> constants:
>>> >>> >> >> >>> handler::scan_time() and handler::read_time().
>>> >>> >> >> >>
>>> >>> >> >> >>
>>> >>> >> >> >>
>>> >>> >> >> >> --
>>> >>> >> >> >> Roberto Spadim
>>> >>> >> >> >> SPAEmpresarial
>>> >>> >> >> >> Eng. Automação e Controle
>>> >>> >> >> >>
>>> >>> >> >> >
>>> >>> >> >>
>>> >>> >> >>
>>> >>> >> >>
>>> >>> >> >> --
>>> >>> >> >> Roberto Spadim
>>> >>> >> >> SPAEmpresarial
>>> >>> >> >> Eng. Automação e Controle
>>> >>> >> >
>>> >>> >> >
>>> >>> >>
>>> >>> >>
>>> >>> >>
>>> >>> >> --
>>> >>> >> Roberto Spadim
>>> >>> >> SPAEmpresarial
>>> >>> >> Eng. Automação e Controle
>>> >>> >
>>> >>> >
>>> >>>
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Roberto Spadim
>>> >>> SPAEmpresarial
>>> >>> Eng. Automação e Controle
>>> >>
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > Roberto Spadim
>>> > SPAEmpresarial
>>> > Eng. Automação e Controle
>>>
>>>
>>>
>>> --
>>> Roberto Spadim
>>> SPAEmpresarial
>>> Eng. Automação e Controle
>>
>>
>
>
>
> --
> Roberto Spadim
> SPAEmpresarial
> Eng. Automação e Controle



-- 
Roberto Spadim
SPAEmpresarial
Eng. Automação e Controle