Tuesday, May 25, 2010

NoSQL, a DBAs Perspective

In order to summarize this post I'll just start with this. We will shortly have Redis deployed in our production environment. I can't really tell you how happy this makes me.

As a DBA, and more importantly an "Open Source DBA", I find many of the new NoSQL options intriguing.

MongoDB:
I've been following the MongoDB project for a while now, and while it's not my cup of tea it does seem very interesting. I've been a web developer for 12+ years and can see where some might think it's a perfect fit, but the traditional developer in me wants data structures that make more sense to programmers. Developers have been struggling with SQL for so long it seems odd and off-putting to replace it with JSON and another query language. It just doesn't seem like the way to go. ActiveRecord is very popular because it feels like regular OOP and fits the developer mindset.

Redis and Ohm:
Wow. It's almost like an epiphany. All my data structures including queues, hashes, arrays, even time series data(sorted lists) stored conveniently in a wicked fast central location. It's like the grail for programmer happiness. Developers don't have to learn anything new. Great libraries handle the interaction with the DB and make it feel as natural as possible to work with these data structures.

All I can say is watch this space. If you're reading this and haven't been following the Redis project. Go check it out. You'll be glad you did. I've been looking for an optimal mechanism for storing time series data for 10+ years now. I'm a huge telemetry geek and Redis with sorted sets is a game changer.

Hashes for storing variable length object data is sweet too. The newest Ohm libraries are using this new functionality and I'm sure the speed is amazing. Forking to save the data is a bit memory intensive for large sets, but it's a nearly optimal solution to the problem of persistence.

I could go on but I won't. You can probably tell I'm very interested in Redis and look forward to many projects using this novel new tech.

I suspect that SQL databases are here to stay, but options are always welcome. If NoSQL does end up taking over the world I'm one DBA who's happy to go back to dev and use these great new alternatives.

Tuesday, May 18, 2010

Slight delay

Well you may have noticed that the 15th came and went. There's been a slight delay in a datamapper release I've been waiting for. The current release uses objectspace features and those of you familiar with JRuby know that it adversely affects performance if you use them. The DM folks promise that the fix has already been applied and are rolling a release in the coming week(s?).

As soon as this happens I should be ready to roll some gem releases of my own.

I've been thinking of ripping out echoe in favor of just gemcutter anyway. Maybe I'll use the extra time to do that. If nothing else it would be nice to have both projects maintained in the same way.

Monday, May 10, 2010

Gonna try this blogging thing again

Now that I finally have something to offer. I'm going to try this blogging thing again.

I have two gems in the works. One is a framework called CommonThread for message oriented middleware in JRuby. The other is a JRuby wrapper for SNMP4J called SNMP4JR.

I just opened fresh new Lighthouse accounts for both and am ready to start working on public releases. I'm shooting for May 15, 2010 for a public gemcutter release of both.

For those of you who have tried/use phpMyTop or MyTop.rb I have updates coming for you all as well. I'll probably be moving them from sourceforge to github however. I see no reason to split my projects up. I'll shoot for June 1 for these. The fresh new versions are actively in use here at Manheim, but need some love for public consumption again.

The big development push is something I've been working on for years now. CommonThread is going on 6 years old now and has been significantly reworked this year for JRuby. Ruby never had good enough threading support to warrant a public release and JRuby wasn't mature enough(IMO) until recently. We now have a thread safe ORM in Ruby/JRuby called DataMapper. I've stripped out ActiveRecord in favor of it, however you can use any thread safe ORM you like. I tried Ohm with it for a bit, but had some threading issues with redis(that have been fixed now). If you need extra performance I strongly suggest it. I'll be adding queue support for Redis in the near future as well as JMS once I complete my JRuby conversion of the framework.

The goal is to use CommonThread and SNMP4JR . . as well as Jmx4r to build a fantastic database management/monitoring tool that surpasses MyTop.rb. My goal is a public release by the end of the year. So I'll be using the gems I'm releasing for a substantial project, much like the folks at 37Signals.

I'm going to blog along the way so watch this space.

Wednesday, June 13, 2007

Greenspan says China won’t sell U.S. bonds … because no one would buy!

I'm a bit blog happy today. Just couldn't resist this one. :) Granted, they'd never pull out wholesale, but there's a concerted effort to diversify.

By Pedro Nicolaci da Costa
Reuters
Tuesday, June 12, 2007

http://www.reuters.com/article/ousiv/idUSN1228045520070613


NEW YORK — There is little reason to fear a wholesale pullout by China out of U.S. government bonds, former Federal Reserve Chairman Alan Greenspan said on Tuesday.

While expressing concerns about China’s runaway growth rate and what he described as overvalued stocks, Greenspan played down the prospect that Chinese authorities would sell Treasuries in earnest, forcing a sharp spike in U.S. interest rates.

Asked at a commercial real estate conference if investors should be worried about this oft-cited concern, Greenspan said: “I wouldn’t be — no.”

Still, Greenspan said the reason such a withdrawal was unlikely was that China would not have anyone to sell the securities to, hardly the sort of comfort jittery bond investors were seeking.

U.S. government debt has been under severe pressure over the past week, with yields rising sharply on anxiety over the likelihood that global credit conditions would tighten as the year progresses. Bond prices move inversely to yields.

Greenspan reinforced the nervousness, saying that a global liquidity boom which he traced back to the end of the Cold War would not go on forever.

“Enjoy it while it lasts,” he told the audience.

Now a private-sector consultant following more than 18 years at the U.S. central bank, Greenspan reiterated his prediction that China’s latest growth spurt had come too far, too fast.

“We cannot continue this rate of growth in China and the Third World. This cannot continue indefinitely,” Greenspan said in a speech. “Some of these price/earnings ratios are discounting nirvana.”

Chinese bank would expand into U.S. and Russia

Here's a nice follow-up to my earlier post.

By Jamil Anderlini
Financial Times, London
Tuesday, June 12, 2007


http://www.ft.com/cms/s/3b314b7a-1913-11dc-a961-000b5df10621.html


HONG KONG — Industrial and Commercial Bank of China, the country’s largest lender, has applied for banking licences in the US and Russia as it seeks to expand outside its home market, the bank’s chairman said on Tuesday.

“We have applied to regulatory authorities in the US, Russia, and other places to set up operations,” Jiang Jianqing, ICBC’s chairman, said after the bank’s annual general meeting. “Global investors are all looking at the BRIC countries — Brazil, Russia, India, and China — and we are very interested in increasing our operations in these markets too.”

The bank’s global ambitions represent a sea-change from just four years ago, when the country’s state-owned lenders were struggling with mountains of bad loans and poor management.

“Many of the country’s banks were insolvent just a few years ago and it is only very recently that they have begun to clean up their act,” said Charlene Chu, banking analyst at Fitch Ratings.

In recent years Beijing has bailed out the country’s largest lenders to the tune of $430 billion (£218.4 billion) through direct equity injections and carving out bad loans.

The banks have also sold a further $70 billion worth of shares to foreign strategic investors and the public through initial public offerings in Shanghai and Hong Kong, and insist they have improved vastly their non-performing loan ratios, corporate governance, and risk management systems.

“We expect ICBC will be looking to do a lot more acquisitions because they have a lot of money and they definitely want to go global,” said May Yan, China banking analyst at Moody’s rating agency.

But the bank faces opposition to its plan to expand in the US because of concerns it does not meet American regulatory standards. The issue has been raised in the bilateral Strategic Economic Dialogue, with the US agreeing last month to consider Chinese bank applications to open US branches under “the principle of national treatment.”

While foreign banks have been making significant inroads into China in recent years and are pushing hard for greater access, Chinese banks are largely excluded from foreign markets because of a history of poor risk management and corporate governance.

Bank of China, which has the largest overseas operations of any Chinese bank, agreed to pay a fine of $20 million to US and Chinese authorities in 2002 for alleged misconduct at one of its New York branches, which included charges of fraud and preferential treatment for customers with personal relationships with bank officials.

ICBC does not have plans to expand in the UK but has seen “very positive developments” in its London operations, Mr Jiang said.

Caught you!

By REUTERS
Published: June 13, 2007
Morgan Stanley will pay $4.4 million to settle a class-action lawsuit with brokerage clients who bought precious metals and paid storage fees, according to a court filing.

The proposed settlement, which is subject to approval by the Federal District Court in Manhattan, includes $1.5 million in cash and other benefits valued at about $2.9 million, according to a court filing on Monday.

The suit, filed in August 2005, asserted that Morgan Stanley told clients it was selling them precious metals that they would own in full and that the company would store.

But Morgan Stanley either made no investment specifically on behalf of those clients, or made entirely different investments of lesser value and security, according to the complaint.

http://www.nytimes.com/2007/06/13/business/13morgan.html?_r=1&dlbk&oref=slogin

Thank you GATA!

US Dollar Purchased by China and Japan

For Immediate Release
Awksedgreep,
The Coordinated Press

In some rather odd news today the US Dollar has been purchased by China and Japan. Now owning 53% of the bonds issued as reserves for the currency. While the new owners have yet to exert major influence on the company, insiders say it is just a matter of time. One of the reasons cited by the new owners is the belligerent existing senior team, which will likely all be asked to resign and may well be brought up on corruption charges. One noted Austrian economist and Presidential candidate, Ron Paul, suggested that this is just one of many hints that restructure and reform is needed. This would also imply that the end of the monopoly/hegemony has already taken place.

The financial team is scrambling with hostile takeovers and many threats to keep the status quo, but so far the rhetoric has not been successful. It is likely that the financial team will be relieved of its duties and conservative alternatives put in their place.

The senior team is being charged with corruption and analysts predict that this hardship will last at least 20 years and will affect the entire company. This will likely cause massive layoffs and result in the largest corporate downsizing in history.

The US Dollar company is a fascist, for profit, institution which should exist by the people for the people and provide for the common good. This had been the case until 1913 when a new financial team was hired to keep the books, but have since run the business into the ground. The press office can be reached at press@whitehouse.gov