Tuesday, December 9, 2008

eJabberd for Instant Messaging


eJabberd Open Source Instant Messaging Server

Another "victim" in the ongoing saga of free open source software (FOSS) being hijacked by a commercial entity only to be later sent to the deadpool is Jabber, recently acquired by Cisco. A project begun in 1998 by Jeremy Miller (per wikipedia) and first released in 2000 as jabberd, Jabber quickly became the basis for the XMPP protocol standard. Probably the most well known adopter of XMPP is Google with the Google Chat software. Many other commercial software companies have also adopted the proven and well regarded XMPP standard for their own integrated messaging, VoIP and presence awareness applications.

Recently I had a customer discussion that centered around an issue with the lack of phone lines (in-coming and out-going) between their distribution centers. There were complaints coming in from the warehouses of busy signals during the peak times of the day. The initial discussion centered around the possibility of voice over IP (VoIP) being a way to solve the problem via provisioning more voice lines between locations. Ok, so not being one who carries around a hammer looking for nails, I asked a more obvious question - what the heck is everyone trying to call each other for at 4pm? The answer was "instant gratification", the warehouse people and order processing people needed quick answers so orders could be completed and picking tickets issued, so trucks could begin being loaded. Email was "too slow" to wait on those simple questions - so my obvious response was - so what about instant messaging. You'd have thought I asked someone to streak naked through the parking lot... no way, then people would be wasting time IM'ing their friends all day instead of WORKING, was the response. Ok, so I had to clarify, I wasn't talking about using AOL or Yahoo, etc., I was talking about implementing an in-house IM server. Response: "We looked at MS Messenger and IBM Sametime, and that's more than we want to spend on IM." Yes, the same people who wanted to throw a VoIP solution at a POTS line congestion problem that would have cost in the high tens of thousands of dollars were balking at spending $40k on IM. As usual, I had a suggestion: "So what about open source, maybe something like Jabber?" Again, a blank stare. I had to pinch myself to make sure I hadn't time warped back to 1998, but no I was again having the "open source is OK" conversation.

After a lengthy discussion I made the suggestion to download eJabberd and use Pidgin as the client for testing purposes. My reasoning for going with eJabberd is that for a customer like this, it would be best to have an option for a commercial support option for the software. With eJabberd that option is available from Process One among others. I'm not doing an ad here for them so just take that as a mention of an alternative. Anyway, just keep in mind that there are options out there to solve problems that don't have to cost a great deal of money.

Typically, if you can win the technology adoption battle via use of FOSS, then if you need advanced features later as user adoption matures, the money to move to a commercial package seems to magically appear where none was available before. The ISVs figured this out a LONG time ago by offering shareware or feature/function-limited freeware versions of their software. It used to be called the "puppy dog close" in sales school - get the client to own it, name it, care for it, feed it and love it, and you're guaranteed they'll have to buy food for it, get it shots, etc. It just never ceases to amaze me that internal IT departments still haven't figured out that they need to get the technology in the door and working and then proving usefulness to management only takes turning off the unauthorized project server and waiting for users to start hollering.

If you're in need of a good IM server, eJabberd is a great option. You can click on over to XMPP.org and see a list of other server options as well as a list of client options.

Monday, November 17, 2008

xkoto for MS SQL clustering


xkoto Gridscale: A better way to cluster MS SQL?



If you've ever tried to implement a MS SQL server cluster then you're familiar with the quorum drive concept and how it is used for clustering. Microsoft's NTFS is a single instance filesystem that does not have a clustering component. While there are replacements for NTFS like HP's Polyserve cluster filesystem product, I recently uncovered xkoto Gridscale. xkoto's Gridscale for MS SQL is a very different approach to clustering. I was fortunate enough to have a brief technical discussion with one of their engineers the other day and here's the short version of his explanation of Gridscale. The Gridscale product claims to avoid the scalability limitations, technical complexity, and costs associated with traditional clustering, mirroring and replication solutions for SQL Server by assisting you to scale application load horizontally across multiple, active-active instances of SQL Server. Also, you can eliminate planned and unplanned database outages since all SQL Servers managed by Gridscale are fully active. Finally, since Gridscale supports databases in remote locations, you can meet disaster recovery requirements without the complexity of traditional transaction-based (journaling) or storage replication solutions.

Ok, so this begs the obvious question: How does this work? Well, Gridscale runs on a pair of gateway (my term, not theirs) servers (active/passive). These gateway servers run between your applications and databases (see the image above this post) to manage multiple, active-active copies of SQL Server databases running anywhere on the network. Gridscale then load balances read requests, while write requests and database changes are propagated asynchronously to all databases to keep them in sync. The SQL Server instances themselves operate completely independently from one another, unaware that they are part of a pool of database servers. xkoto claims that with Gridscale, applications typically require little to no modification beyond the use of a special database driver (standard ODBC or JDBC are two options) which talks to the database virtualization server (the gateway servers).

The Gridscale architecture also allows for on-the-fly addition of SQL server nodes to the cluster, as well as the ability to script a node to remove itself from the cluster while backups are performed and then the node can be re-added to the cluster and updated. If my notes are correct this has been tested out to twenty (20) nodes in a single cluster configuration. One slight limitation is that each gateway pair can only address a single instance of the SQL database engine per server (or in this day and time of virtualization, per operating system instance). So if you have multiple SQL instances per server (not multiple databases now, multiple instances of the SQL database application engine in memory), then you'll need to deploy multiple Gridscale gateway pairs.

The xkoto Gridscale for MS SQL was just introduced back in September as a follow on to their very successful and mature Gridscale for DB2 product.

Wednesday, October 8, 2008

Google 10 to the 100th Project

October 20th Deadline Approaching

http://www.project10tothe100.com/how_it_works.html

How it works

Project 10100 (pronounced "Project 10 to the 100th") is a call for ideas to change the world by helping as many people as possible. Here's how to join in.

1. Send Google your idea by October 20th.
Simply fill out the submission form giving Google the gist of your idea. You can supplement your proposal with a 30-second video.

2. Voting on ideas begins on January 27th.
Google will post a selection of one hundred ideas and ask you, the public, to choose twenty semi-finalists. Then an advisory board will select up to five final ideas.

3. Google will help bring these ideas to life.
Google is committing $10 million to implement these projects, and the goal is to help as many people as possible. So remember, money may provide a jumpstart, but the idea is the thing.

Good luck, and may those who help the most win.

Remember, the deadline is
October 20th, 2008

Guidelines

Google's goal is to set as few rules as possible. However, they ask that you put your idea into one of the following categories and consider the evaluation criteria below.

Categories:

* Community: How can we help connect people, build communities and protect unique cultures?
* Opportunity: How can we help people better provide for themselves and their families?
* Energy: How can we help move the world toward safe, clean, inexpensive energy?
* Environment: How can we help promote a cleaner and more sustainable global ecosystem?
* Health: How can we help individuals lead longer, healthier lives?
* Education: How can we help more people get more access to better education?
* Shelter: How can we help ensure that everyone has a safe place to live?
* Everything else: Sometimes the best ideas don't fit into any category at all.

Criteria:

* Reach: How many people would this idea affect?
* Depth: How deeply are people impacted? How urgent is the need?
* Attainability: Can this idea be implemented within a year or two?
* Efficiency: How simple and cost-effective is your idea?
* Longevity: How long will the idea's impact last?

©2008 Google

Monday, September 22, 2008

VMware clones and Windows SysPrep

Using VMware's clone option is half the battle

Ok, so I called customer "GL" the other day to check on how his VMware ESX farm was doing and he said "great, but I'm having a problem using the OS templates". Of course I asked, how so and thus began the adventure. Now, I'm not a Windows OS expert by any means so if I mis-speak on some of this give me some latitude, ok. Here's the scenario - VMware, via VirtualCenter, gives you the option to set up an OS template with all of your usual utilities installed (antivirus, backup agent, etc.) and then "clone" that template to make rolling out a new virtual server much faster. Well, "GL" had set up the template OS, cloned it, and then used Microsoft's NewSID utility to create a new ID for the server. He did this for seven new virtual servers he was rolling out. All was fine until he went to check the new virtual servers into his Microsoft Windows Server Update Services (WSUS) server. The first server checked in just fine, but each subsequent server replaced the former, always appearing to be the same server OS instance, but remember there are seven of them. Hmmm - odd. So, I did what any good, self-professed non-expert would do - I called a guy who I knew would have the answer. My good buddy and Microsoft Windows OS guru Jeff was on a customer site so he called me back the next day. I explained the problem to him and he provided the answer in short order. I'll spare you the technical browbeating I got from Jeff and just give you the meat of the solution. Jeff's response: "You're using the wrong tool. No, not the VMware tool, that works just fine - the wrong Microsoft tool". And then he was nice enough to explain it to "GL" and I and even sent an email with the solution (for a small price). Jeff's solution: "GL" should have been using SysPrep, not NewSID. Since there was more than just a base-OS in the template, there were other programs that needed new identities as well as the base OS and NewSID didn't do that. So here's an excerpt from Jeff's email:
=====================================================================
To be clear, before you ran Sysprep on the source workstation, you
cleared the AccountDomainSid, PingID, and SusClientId keys (if they all
exist) within the Registry as well as clicked 'Reseal' within the
Sysprep utility?

Here is a script you can run on the source workstation prior to running
Sysprep to test again.

<- CUT HERE ->
NET STOP wuauserv
REG DELETE
"HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\WindowsUpdate" /v
AccountDomainSid /f
REG DELETE
"HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\WindowsUpdate" /v PingID
/f
REG DELETE
"HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\WindowsUpdate" /v
SusClientId /f
NET STOP wuauserv
<- CUT HERE ->
=================================================================

Like I said - Jeff's a guru when it comes to all things Microsoft OS related and that's why my first call was to him. So, lesson learned. VMware templates are a GREAT way to roll out new Microsoft Windows Server OS based virtual servers quickly, just know that there's a little more work to be done before you push the new image into production (and add it to WSUS).

Another great day of fine customer service...

Friday, September 19, 2008

gMail account verification code

Save that gMail verification code

If you didn't get a chance to read Lifehacker yesterday, make sure you read Gina's post about Google's gMail account verification code. As a prolific user of Google gMail, Docs and Sites which use the same account login, I took her note to heart. If you ever get locked out of your gMail account, Google will ask you for your account verification code, which was sent to another of your email accounts when you signed up for your gMail account. If you didn't discard that email, then go back and find it, print it, print to a PDF and save/archive, store the account verification code in your password organizer; find some way to make sure you can find this again if you need it. If you're like me and have tons of documents on Google Docs, it would be no small disaster should you get locked out of your gMail account, so take Gina's advice and act now to save this information before you need it.

Thursday, September 18, 2008

Open Source Backup

Server and PC backup using Open Source alternatives

Whether you need a desktop productivity suite, network and systems monitoring tools, database, web server or other core application in the datacenter there are plenty of open source alternatives. One option that doesn't get a great deal of attention is the availability of open source backup and recovery applications. While space and time don't allow me to cover all of them, let me hit a few highlights.

Amanda backup and recovery software from ZManda is by far one of the premier open source alternatives for backup. While the server portion of the application runs on Linux, it has agents for Windows, Linux, Unix, Mac, etc. Amanda even has an agent for MySQL. One of the primary advantages to Amanda is the fact this it uses no proprietary drivers to address backup devices, it leverages the operating system device drivers. Also, Amanda uses standard dump and tar for backups so you could restore even when you didn't have the software available. While not a replacement for a large enterprise solution, it gets you backups of your critical data into an easily recoverable format across multiple operating systems.

Restore-EE is another open source backup and recovery program that is available on SourceForge. It has an option to test using the downloadable ISO that has the Ubuntu boot from CD option. If you select to install you'll need a clean server environment, either base hardware, a multi-boot partition or a virtual machine, since it installs a base OS with all the application files.

Bacula is another application for backup and recovery the requires OpenSuSE Linux, FreeBSD, or Solaris operating systems as the server OS. Bacula is also pretty much a linux-focused program with little or no support for Windows platforms; but, if you're a Linux shop this is worth a look.

SnapBackup is an interesting option in that it's a java-based program and will run on most any desktop OS platform (Linux, Unix, Windows, Mac) that supports java. SnapBackup is intended for use as a backup and restore program for desktop PCs, not servers, so it's a great solution for use on your laptop or home PC.

If you're more technical and are looking for some real-time replication and file-based directory synchronization, there are programs like rSync for Linux and Unison, a more cross-platform option. My personal favorite for directory sync from a PC (or server) is Novell's open source iFolder, based on the Mono/.NET framework. Or, if you're a Microsoft shop then DFS (distributed file system) may be your cup of tea.

While file backups are great to have, don't forget to use something like SelfImage to create a bare metal recovery backup image of your hard disk(s) so you can get your PC or server back to a usable state quickly and then worry about file recovery. While not free and open source, an affordable honorable mention in this category is Acronis True Image Home for the low cost of $49.00.

You'll notice I haven't gone off into a hosted, backup software as a service rant yet. While there are plenty of options available out there like Carbonite, I'll save that for another post.

Thursday, September 11, 2008

Online File Storage

AOL xDrive with Adobe AIR

I've been an AOL xDrive user for some time now and have a tendency to try out all the latest online file storage concepts as they hit the web. Lately I've been so caught up in my web travels and testing out new options that I hadn't visited my xDrive account lately. For large email attachments the simplicity of Senduit has been a easy and quick choice to make, and uploading Powerpoint presentations into a hosted Google Docs file has been almost painless. The downside to Senduit is that the uploaded file and it's generated link "expire" in a short period of time and people who backtrack through emails and want to download the file again get an error.

So to have a more permanent link solution without filling up people's inboxes with multi-megabyte files, I revisited my old tried and true AOL xDrive account the other day. Much to my surprise and delight, there is now an xDrive Desktop Lite offering that sports an Adobe AIR interface. I'm still in the process of testing it out and am even using the VMware ThinApp SDK to see if I can create a portable, install-free version of the AOLxDDL application (I'll update you on how that goes later - I still don't have the Cisco VPN client done yet...). Anyway, the AOL xDrive service gives you the ability to upload EXE files, MSI installation packages, firmware updates, bios utilities, and all those other types of files you seem to need access to on an irregular basis. Once there the files can be private or shared with others. For ease of use you can group files together into a folder and share the whole folder instead having to mark and share each individual file. Also, for those files you need to save and you're offsite with limited bandwidth, xDrive lets you save files directly from the web to the xDrive storage, avoiding having to download to your PC.

I know, this has been another one of my "storage as a service" soapbox speeches, but one that should be taken into consideration. I also read over on LifeHacker.com that Dropbox, another online file storage offering, is now coming out of Beta so I'll be checking that one out soon as well.

What do you think about online storage and what's your favorite?