Interesting Things

A New Year and Fun New Challenges

2011 is a new year and I’m focused on some great new things.  So, I thought I post a little note to try and get myself back into the blogging groove and lay the ground work for some posts to come in the near future.

First of all, I’m working primarily for a company called SolutionSet now.  SolutionSet is the 4th largest independent marketing agency in the United States and has four divisions.  They are data, direct, local, and digital.  I work for the digital division.  The areas I focus on are Business Development, Systems Engineering and Architecture, and building up a new Ruby Web Site/Application development practice.  I’ll be blogging here and on the SolutionSet blog about my various endeavors in those three areas over time.  For a peek into this early part of the year, the kinds of projects I’m involved in at the moment are:
  • I am working with an excellent team that I have taken over at SolutionSet.  Together we are creating a more scalable Systems Engineering and Architecture practice at SolutionSet.  Every day we Architect, Designing, Building, Deploying, and Maintaining websites for our awesome clients.  We have a strong focus on systems automation using tools like Chef, Vagrant, IaaS public and private clouds, and are development excellent and scalable processes to get ready for 2011.
  • I’m working on a very exciting social media project for a major client on a project I can’t really talk that much about yet.  I can say that it has the potential to shake up the way people view and use aggregated social media data for driving core business value.  This project is interesting in particular because it’s using a very cool technolog stack.  This will be a Scala/Erlang application with a Riak datastore on the back-end.  I’ll post more about this stack in detail upcoming blog entries.
  • I’m involved as the Systems Architect and Scalability Architect for the planning, design, deploy, and on-going operations of a very large and complicated website deploying on the Terremark eCloud.  This one, if you can believe it is a .NET CMS / MSSQL server project.  It’s interesting to see how the closed source models compare to the open source models I’ve done so much work with over the years.
  • I’m doing a Scalability “Launch Rescue” mission for an up and coming geo location related service.  When they got ready to go live they found that their system couldn’t handle nearly enough load to support the current users and what their promotions and social media campaigns would bring in.  So, I was brought in by a partner to help them rework things so they can launch.  This is a pretty cool project and if they give me permission to speak more freely I’ll definitely have a lot more to say about it soon as well. I think I’ll be able to say more after it’s live.  They have a very clever idea and I think they could do quite well.
  • A little side project with a friend of mine for a developer workstation rapid application development environment with the proper tools and chef based automation for multi-public cloud deployment of a highly optimized ruby centric technology stack.  This is some seriously cool stuff and we successfully used the prototype to launch an extremely successful hyper concentrated web traffic pre-ticket sales event campaign for the Jonas Brothers last year.  The other thing that was awesome about this project was the use of BrowserMob to do some sophisticated load testing and Dynamic DNS for some serious scalability and flexibility way up the stack.

That’s just a little preview!  All in all I’m very excited and optimistic that 2011 is going to be a great year all around!  Most importantly, the array and quality of technology that is available to do things at big scale with concentrated effort and resources.  This is a sweet time to be in the technology space I think!

Lastly, I do have upcoming events.  I’ll start posting them here as well.

In summary, 2010 was a hell of a year by any measure and 2011 looks promising.

Next Weeks Event Highlights:

Engine Yard: Cloud Out Loud Podcast Interview - I’m being interviewed by Engine Yard (and am very excited to be working closely with them as a partner).  I will post/tweet a cross link when the podcast is up on the site.

Using RVM on Ubuntu 10.10

I wanted to use RVM for some testing with Ubuntu 10.10 last night.  Not one set of instructions I found around the web would work.  At the end of the day it was actually something rather simple; a path issue.

As the documentation clearly points out, you need to make a couple of modifications to your .bashrc script for things to work properly.

Here is what all the instructions say to past at the end:

[[ -s "$HOME/.rvm/scripts/rvm" ]] && . "$HOME/.rvm/scripts/rvm"  # This loads RVM into a shell session.

 

Here is what you really have to paste at the end:

[[ -s "$HOME/.rvm/src/rvm/scripts/rvm" ]] && . "$HOME/.rvm/src/rvm/scripts/rvm"

                             ^^^^^                                                     ^^^^^

Notice the path differences.  I have no idea why this is the case but it is.  I had the same issue on previous Ubuntu version as well though.  Well, this cost me a little bit of time but once I made that change along with the other documented changes everything has been just peachy.

 

root@mavrvm:~# rvm --default 1.8.7
root@mavrvm:~# ruby -v
ruby 1.8.7 (2010-08-16 patchlevel 302) [x86_64-linux]
root@mavrvm:~# rvm --default 1.9.2
root@mavrvm:~# ruby -v
ruby 1.9.2p0 (2010-08-18 revision 29036) [x86_64-linux]
root@mavrvm:~# 

root@mavrvm:~# rvm --default 1.8.7root@mavrvm:~# ruby -vruby 1.8.7 (2010-08-16 patchlevel 302) [x86_64-linux]root@mavrvm:~# rvm --default 1.9.2root@mavrvm:~# ruby -vruby 1.9.2p0 (2010-08-18 revision 29036) [x86_64-linux]root@mavrvm:~# 

 

Gluster 3.1 GA Release

Over the past couple of months I was taking a really close look at GlusterFS for potential use on a virtualization project.  Today I saw the notice the version 3.1 was released.  That's good news.  They call it a scale out NAS platform which it is but it's also a bit more than that too.

I had the chance to speak at length with Anand Babu (AB) Periasamy and a few members of his team at VMWorld recently about 3.1 prior to release and it was genuinely interesting and exciting. I've been following the Gluster project for years and it really just seems to keep getting better and better.  Not only that, they seem pretty passionate about what they do which is always a good thing.

Of particular interest in 3.1 is that you are now supposed to be able to add and remove nodes to the cluster without impacting the applications using the cluster at all.  This is CRITICAL and was a major barrier to adoption perviously.  Previously you actually had to restart the cluster to expand.

One of the things that can be challenging is large scale file sharing to many, and sometimes varying numbers of, application servers in large scale web environments.  I could see GlusterFS 3.1 being very useful in this scenario.  One recently published example of this is the way that Acquia uses GlusterFS for scaling Drupal.  

Of course, other options exist such as Swift from open stack, MongoDB w/ GridFS, Riak perhaps in smaller file size senarios, and perhaps Ceph which just released.  The file / storage space is hot right now with change and even *gasp* innovation.  It is pretty exciting and more choice over the last few years has been a very good thing.

I suspect I'll be writing more about this in the future assuming I can get some of the testing I want to do completed.  As usual, my lab in my secret lair is under powered and over utilized. *sigh*

Interviewed by Silicon Angle TV at VMWorld 2010 - Cloud Provider Spotlight

I was recently interviewed by the fine team at SiliconAngle.tv during VMWorld 2010. It was a lot of fun and they were very professional about it all. As is usually the case I suppose after I was done I wished I had done many things differently and said things differently. But, none the less it was a good experience. So, a shout out to Silicon Angle to say thank you and to Falconstor for helping set it all up as well. 


Click Image to Go to Video at Silicon Angle

 

ZeroMQ Musings and Server Build

zeromq

I just read an excellent writeup about ZeroMQ (ØMQ/ZMQ) yesterday on igvita.com.  This software appears to have been around a while but I hadn't seen it before.  It's really quite impressive.  So, I found myself quite curious to play around with it a bit this weekend.  So, I built a little rig that would let me do that based on Ubuntu 10.04 LTE.

I wanted to use the ruby bindings for my playing around and ruby 1.9.2p0.  I quickly found that most of the easy to find examples out there are in C or Python.  But, there is still some good stuff.  I'll add some of things I found as links at the bottom of this post. 

The server build instructions  here in case anyone else was interested.  The following steps will yield you a basic build with which you may test ZMQ w/ by writing ruby code.

If anyone has thoughts, ideas or improvements on this setup by all means please do let me know!  Comments have been off for a while on my blog but I'll be turning them back on after this post.

Server Build - Ruby 1.9.2p0 + ZMQ + Ruby Bindings

While playing around a bit this weekend with zeroMQ and wanting to mess w/ the ruby bindings I found I needed to build a server.  It wasn’t difficult but these are the steps which might help you get going quickly on the rackspace cloud.

Provision Your Server

I grabbed mine from the Rackspace cloud.  Your milage may vary but I know that a RS 10.04 is a well build no frills ubuntu server.  I really like using their templates as the basis for my builds.  Once you have your server up and you are logged in:

You are now all set with a ruby 1.9.2p0 and zeroMQ enabled server on Ubuntu 10.04 in the Rackspace cloud.  If this was helpful then let me know what you do with it as this is a very exciting combination.

Note:  This will work well with any Ubunutu 10.04 server. It doesn’t  have to only be a Rackspace Cloud Server.

For next steps take a look at the basic zeroMQ example published by Will’s Web Miscellany.
Of other notable interest is the Mongrel2 project which incorporates ZMQ.  The mongrel2 manual is very good reading as well.
Other helpful Links I found have been tagged on my Delicious acct here.  I'll be adding more as well as I find them.