I’m working on a new idea… it may or may not pan out… but here are some concepts for your consideration… with some thoughts on their performance implications. First a reminder… a reality check. In my experience if you POC two databases at about the same price point…and one is 30% faster than the other, 1.3X, then…
This short post is intended to provide a quick warning regarding in-memory columnar and cpu requirements… with a longer post to follow. When a row is inserted or bulk-loaded into a DBMS, if there are no indexes, the amount of cpu required is very small. The majority of the time is spent committing a transaction…
In my post here I suggested that database computing was becoming a special case of high-performance computing. This trend will bump up against the trend towards cloud computing and the bump will be noisy. In the case of general commercial computing customers running cloudy virtualized servers paid a 5%-20% performance penalty… but the economics still…
In the post here I listed the units of parallelism (UoP) applied by various products on a single node. Those findings are summarized in the table below. Product Version/HW Cores per Node UoP per Node Notes Teradata EDW 6700H 16 32 Uses hyper-threads. Greenplum DCA UAP Edition 16 8 Recommends 1 Segment for each 2…
When I was at Greenplum… and now again at SAP… I ran into a strange logic from Teradata about query concurrency. They claimed that query concurrency was a good thing and an indicator of excellent workload management. Let’s look at a simple picture of how that works. In Figure 1 we depict a single query…
I was recently reminded of a couple of papers written by Jim Gray and Gianfranco Putzolu that calculated the cost of keeping data in memory vs the cost of paging it in from disk. I was happy to see that the thread was being kept alive by Goetz Graefe. These papers used the cost of…
In my first blog (here) I discussed the implications of using co-processors to offload CPU. The point was that with multi-core processors it made more sense to add generalized processing hardware that could be applied to all parts of the query process than to add specialized processors that dealt with only part of the problem.…
The SAP Business guy at Virtustream including EMC Federation
A melting pot for Enterprise Software, Analytics, Food, Sports, Politics and everything else that interests me
database research in the real world
Platform, Database and Storage Topics
Research into current database technology
It is about Architecture... not about Marketing...
