@paulogaspar7

Logging (and Exception Handling)

2012-01-21T00:28:00.001Z

During the last year, the exception handling and logging themes have been quite recurrent, even leading to a talk I gave at Codebits 2011.

Since the theme is still coming back to me, both at work and online (this time via Sergio Bossa), I decided to dump here some of the information I have been collecting and producing.

For starters, this is an enriched version of the slideware I used for the above mentioned Codebits talk:

Exception+Logging=Diagnostics 2011

(Other of my presentations can be found here.)

As with my previous presentations, if you download it, you will find some extra information (including the URLs of the most important sources I used) at the slide's comments. (I am sorry, but SlideShare does not seem to be able to display the comments from the Powerpoint format I used this time.)

Anyway, my favorite articles and presentations about logging are currently here:

Naturally, I do not agree with everything written in the above mentioned articles. Well, give it some time and I might not agree with everything I wrote on my own slideware...

I believe, however, these articles to be useful fuel to help anyone, with enough critical thinking, to build their own paths.

Having to talk about logging helped me to step further away of the self centered view most developers seem to have about logging. I had already taken a few steps out of there by working together with sysadmins and other colleagues, supporting the larger applications I worked on and sharing their pains. But making a presentation always forces me to have a much deeper reflection about the presentation's subject.

That is why my slideware focuses on the communication role of logging, as do several of the above mentioned sources.

Instead of developing this blog entry further, just read with attention the above articles. Believe me: must of us have a very bad logging communication... Poor sysadmins!

My "Distributed Programming and Data Consistency" Codebits talk slideware

2009-12-22T05:21:00.002Z

I am finally publishing the slideware for my SAPO Codebits 2009 talk entitled "Distributed Programming and Data Consistency".

I first wanted to complete its notes in order to:

Allow its use independently from the talk's video (in Portuguese);
Provide enough bibliography / reference material to ease further study on any of the covered issues.

Here it is:

Distributed Programming and Data Consistency w/ Notes

View more documents from Paulo Gaspar.

Codebits 2009

2009-12-09T03:21:00.002Z

I finally went trough the Codebits experience:

http://codebits.eu/

I ended up having the chance to have a rather complete experience too, not only attending but also by giving a talk and competing in the famous 24 Hour Programming Contest.

Not everything went perfectly, but it was an amazing experience.

Please believe that I don't use the word "amazing" as liberally as those people you often watch on TV. This was really interesting and I want to repeat it next year, if I have the chance.

Pictures:

The title of my talk was "Distributed programming and data consistency" and there is a video (Portuguese spoken) here:

http://codebits.eu/intra/s/session/85

The talk mentioned several NoSQL data handling techniques, but the focus was mostly on Data Consistency, CAP and BASE / Eventual Consistency.

After watching me back I just found out how much I have to improve as a speaker. The feeling I have is like:

The guy which studied the subject and prepared the slides did a good job;
The guy which presented it must be "a bit" livelier, have better tempo.

I will try to watch this video again before I do any other talk... but in case it goes offline I took notes too (with all the gory details I am avoiding to mention here). =;o)

In the next days I will prepare a version of the slideware with better notes, which will include the URLs of the most interesting literature I came across about this subject.

The last NoSQL conferences...

2009-11-02T13:15:00.003Z

I spent part of the weekend taking a broader look at the NoSQL scene, given the flood of information resulting from these last two conferences:

NoSQL East 2009 - https://nosqleast.com/2009/
NoSQL BErlin - http://nosqlberlin.de/

I mostly went trough some of the notes already online, harvesting related information and updating my recently reactivated delicious.com account.

Most interesting summaries and other resources I found from these events:

NoSQL East 2009 - Summary of Day 1 by @uggedal
NoSQL East 2009 - Summary of Day 2 by @uggedal
NoSQL East 2009 Redux by Jon Moore
NoSQL Berlin Meetup Notes by Phillip Oertel
NoSQL Berlin slides
NoSQL Berlin videos

I also ended up finding some interesting older notes about another nosql meeting:

Notes from the (SF) NoSQL Meetup at the Yahoo! Developer Network Blog

The NoSQL Hype

As usual, the "NoSQL" moniker keeps being a bit irritating to me. Some of the stores qualified as "NoSQL" only aim at being efficient DHTs.

But those that aim at being databases end up having some kind of query language, although often a really poor one - which means query languages have their use...

And nothing prevents you from using a sharded (even with mirrored shards) MySQL database as a key store - and many companies are doing just that.

I am NOT against innovation. My problem with many "NoSQL" solutions is that:

They do NOT present enough progress while ignoring lessons from past experience;
They pretend to innovate some backend aspects while sending you back in time on the API / interface side;
They pretend to be revolutionary while doing nothing better that well known commercial solutions (e.g. Coherence).

If you just want to implement / defend / promote an open source version of a previously existing concept, be modest and don't pretend to be part of a revolution.

History Repeating

So, while there are many interesting Open Source solutions qualified as "NoSQL" popping up, there is too much hype around the "NoSQL" moniker. Too much old stuff dressed in new clothes and too many lessons from the past being ignored.

Like MVCC, which is being considered by some databases as the magic bullet of data merging, while the lessons learned about its limitations (by communities like the Interbase or Firebird users) are being ignored. This article, for instance, documents how MVCC does not detect data inconsistencies when merging two changesets if the inconsistency is related to data that is only read (resulting in data written to another row/table):

MVCC Serializability issues exposed at ibexpert.net

Besides, Key/value stores are VERY OLD NEWS.

Some old stores are still around, proofed by the years of use and still damn efficient, like Berkeley DB.

But I used even older key/value stores, like the initial versions of c-tree or the Turbo Pascal Database Toolbox from Borland. What I can tell you, from experience, is:

It is much more productive to work with SQL (but you need to learn it);
SQL is not just a programming tool. It is a precious database administration tool too.

Sure, standard SQL is too limited for the new database architectures. But that just means we probably need a new QL (Query Language).

So, the revolution is not having NoSQL but having better databases and a Better SQL.

Don't forget how many persistency layers already tried to kill SQL and failed miserably. Sure, they are OK for basic CRUD tasks, but most applications end up needing much more than that.

To put some hype back on SQL, lets remember how it is truly a DSL.

NoSQL interfaces being more productive that using SQL for all data manipulation is the dream of those who are too lazy to learn SQL. But then it is just a dream.

Cutting the Hype

Since what else I have to say was already said, I will just point to the other guys:

NoSQL: If Only It Was That Easy by BJ Clark
The Trouble with NoSQL by Stuart Charlton
NoSQL isn’t a movement by BJ Clark