Because I only understood the theory of search engine technology it wasn’t as easy as I had thought to start my own and implementing the technology was an extremely complicated experience. My very first version was powered by Lucene but as it was powered by Java (and TomCat) I had great difficulty in getting it to work as expected.

I then ran a version of mnoGoSearch which was run as a Perl command line utility and while this one seemed to give me the best results I had resource issues which hampered my efforts. What I soon figured out was why Google has a few hundred thousand servers powering their search engine and after about a week of indexing South African websites I ran out of disk space. With about 8 million records indexed I had used up my 80GB hard drive.

So, in the end Grabble went PHP and while I retained some indexing capabilities from mnoGoSearch I also tapped into Yahoo to help out. At the time Yahoo didn’t have a search API so I had to do a lot of hacking to get results returned from Yahoo. In particular, Yahoo provided all the image, news, videos, blogs, sport and forum search results.

While being in awe of Google I also felt that total dominance of only a few players in the market wasn’t a good thing. I believed, esoterically at the time, that local search needed to be dominated by a local company. These beliefs I still hold true to heart and I feel that it’s critical that competitors exist. There is something very uncomfortable in knowing that one or two companies hold the majority of the world’s data and I was convinced that Grabble would be a winner.

Almost three years later and I’ve been debating what to do with Grabble. For the last two months the site hasn’t even been operational (well web search anyway) and while I didn’t want to close it down completely I also had to face the reality that Grabble was never going to dominate and I simply did not have the time to maintain it any longer.

Then along came 4hoursearch – a website powered by the Yahoo BOSS search API and running off Google AppEngine. I stumbled across this site by chance and realised that they had released their source code under GPL. Subsequent to this finding I have now moved Grabble onto this Python software and my final version of Grabble has now been hatched.

What this final version does is allow me to keep the site up for those who still want to use it and at the same time it gives me an opportunity to say goodbye. Running through the Yahoo BOSS API means that I don’t have to worry about indexes any longer and living on the Google AppEngine means technology is now taken care of.

I have learnt so much about search through my efforts with Grabble and I hold it very close to my heart. While it never took off it did give me an opportunity to expand my knowledge and experience in an area I felt passionate about and the learning curve I’ve gone through has certainly helped define where I am today.

Making the decision to leave was simple to make in that Afrigator is a passion of mine and I’ve now been given the opportunity to work on my passion full time but on the flip-side it was also extremely difficult. Over the last 14 months I’ve built up very special relationships with Colin, Gregor, Ian and Robin and we’ve grown very close as a team and as a friends.

Together I believe we have provided immense value to the company and I know that I am leaving the iLab in very capable and safe hands. I will now have the opportunity to sit back and watch what the guys produce over the coming months and I look forward to seeing them assist in helping the company reach its goals and objectives.

All I can say is that they will all be sorely missed.

Moving to Cape Town is something I and my family welcome and are looking forward to and while we’ll all miss our family and friends this move will be a life-changing experience for us all. As a parent I couldn’t ask for more than to bring my kids up in a city that has so much to offer and our quality of life is going to improve dramatically as a result.

Packing is now well on its way and on Sunday morning we move into our new home in Claremont. I don’t think we can yet quantify what this all means but I’ll post my experiences on the blog in the coming days and weeks.

Wish us all luck.

Here are the release notes for this version:

• Fixed = iCal bug message saying “no data was added to iCal” thanks to Jon Milan.
• Added = London timezone support thanks to Ryan Hunt.
• Added = West Coast USA timezone support thanks to Ryan Hunt.
• Added = Tallinn timezone support thanks to Ryan Hunt.
• Added = Asia/Muscat timezone support thanks to Steve.
• Tests = Now confirmed to work on Leopard 10.5.1, 10.5.2, 10.5.3 and 10.5.4
• Tests = Now confirmed to work on all Apple computers.

Installing

If you’ve never installed this fix before then please read the detailed installation instructions found over here. If you’re upgrading from a previous version please read the detailed upgrade notes below.

Upgrading from version 1.1

1. Delete the folder /Applications/iCalFix/ in Finder.

2. Download this Upgrade Script to your computer and extract the contents from the ZIP file. The folder contains a Shell script (install.sh) which sets everything up for you.

3. Right-click on the install.sh file, select Open With and then click on Other.

4. Click on Applications –> Utilities –> Terminal. If you can’t select Terminal from the Open dialog then select All Applications from drop-down list below.

5. Terminal will open up and the install script will run. When you see the message “Installation Complete.” you can close Terminal.

6. You can now check if the bug fix was installed correctly by navigating to /Applications/iCalFix/ in Finder. If you see two files installed in that folder then installation was successful.

7. Done. Sit back and enjoy.

I have to say that while Regator has certain elements that share a close resemblance to us I’m of the opinion that Scott and his team did not do this maliciously as I had initially suspected.

I was fortunate enough to have a discussion with Scott Lockhart (co-founder) via email where he assured me that they had not even heard of Afrigator until today. He also gave me access to the Regator beta website and I’ve gone through it extensively.

Having spoken candidly with Scott and seeing what Regator is all about I’m convinced this was simply a coincidence. If anything, Regator is a mashup of a content aggregator with Digg/Reddit style bookmarking functionality and I can now see that when Regator goes live there will be little confusion between our two respective sites.

I wish Scott and his team all the best with their new venture. It’s a tough market but they’re off to a great start.

Regator.com went into private beta today and I picked it up via this Techcrunch article. They’ve also got great exposure on ReadWriteWeb and even Mashable.

These guys are a blog aggregator that not only use the Afrigator crocodile, similar domain name and colour scheme and I have to feel this is a little more than a coincidence.

There is little doubt that Mike, Stii, Mark and myself will need to speak to our legal team to find out what action we can take on this.

What do you guys think?

UPDATE: I’ve had a long chat with Scott from Regator and I’m now convinced it was a coincidence. Please see my updated post here.

Last night we published a brand new Xenophobia topic page on Afrigator which highlights everything that is being covered throughout Africa about the recent xenophobic attacks in our country.

Stii and Mark worked like mad on this yesterday and I’m super impressed with the way in which the page has turned out. I urge you to read the blog post on the Afrigator blog as it breaks down this page into much greater detail.

One thing I found particularly interesting to see is how many blog posts have been written about the xenophobic attacks. As of last night a total of 217 blog posts have been published compared to only 33 news articles on the same topic.

I really believe that this just highlights how everyone in South Africa is condemning these attacks and the fact that so many blog posts have been written is just awesome for awareness.

At this stage though I’m not sure what value 217 blog posts have on actually making a difference but the more we expose this issue the more I would hope it applies pressure on the powers that be to resolve this issue once and for all.

Help spread the word guys… let’s stop this senseless killing.

Anyway, imagine my excitement when I received this email in my inbox this morning.

Eager to test the new service out I went to the website, logged in, and can now build my first application.

Currently the service only supports Python so now I have to figure what to do in this space…!

Wow, can’t believe this thing is one year old already… check out the celebration post on the Afrigator Blog.

The TimesURL FireFox Extension is my first official attempt at a FireFox Plugin and I’ve had great fun in the process, along with some nasty headaches as well.

The add-on allows you to shorten and share a website directly from your browser. Simply click the TimesURL icon and the add-on will automatically shorten the URL for you and present you with the short version that you can share with your friends via email, post to Facebook or bookmark on Muti.

This extension has been tested to work on FireFox 2.0.0.13 as well as the latest Beta version 3.0b4. It’s really simple to install and it’s a great addition for those of you that use Twitter or just want to share links with other people.

We’re working really hard at turning TimesURL (pronounced times-earl) into a destination to share information rather than just to shorten links and there is a lot under development to create this enhanced sharing experience.

If you haven’t used TimesURL before then what better time to start using the service with an easy to use FireFox add-on?

While we’ve found many a work-around to get email up and running using Apple Mail there remains this irritating bug that prevents Exchange iCal events from syncing correctly with Apple iCal.

The reason this bug exists is because Exchange doesn’t use standard compliant timezone information while Apple does and as a result iCal can’t figure out what the correct timezone is from Exchange iCal invitations. Here’s a quick example of the South African timezone differences between the two.

Exchange uses this format:
(GMT+02.00) Harare/Pretoria

While iCal uses this:
Africa/Johannesburg

This means that when a meeting request comes in from a Windows PC, iCal can’t read data beyond the GMT+02.00 and it simply adds on 2 hours to the event. So a meeting sent from Exchange, scheduled for 14:00 actually appears in iCal as 16:00. We’ve missed many a meeting as a result!

Over the last few months I’ve spent countless hours trying to find a fix but no one has managed to get this issue resolved – not even Apple. I’ve now resorted to creating my own bug fix which I’m releasing publicly this morning.

How this bug fix works

The install script downloads all the necessary files from my server and installs both an AppleScript and Shell script to a folder called iCalFix in your Applications folder.

The AppleScript is then assigned to a Mail Rule and runs whenever an iCal invitation is received. The AppleScript downloads the iCal file to a temporary location and the Shell script then runs on the temp file and replaces any incorrect timezone information.

Once completed the new iCal event is then imported to iCal with all the new timezone data in place. The beauty of this fix is that you don’t need to edit any of the package files for iCal and even your original iCal invitations are left untouched. This means that you can upgrade iCal at a later stage and you should be safe from any data corruption.

Installation

1. Download this Install Script to your computer and extract the contents from the ZIP file. The folder contains a Shell script (install.sh) which sets everything up for you.

2. Right-click on the install.sh file, select Open With and then click on Other.

3. Click on Applications –> Utilities –> Terminal. If you can’t select Terminal from the Open dialog then select All Applications from drop-down list below.

4. Terminal will open up and the install script will run. When you see the message “Installation Complete.” you can close Terminal.

5. You can now check if the bug fix was installed correctly by navigating to /Applications/iCalFix/ in Finder. If you see two files installed in that folder then installation was successful.

Setting up the Mail Rule

The last step before you can begin using this fix is to setup an email rule that calls the AppleScript file. Click on Mail –> Preferences –> Rules and create a new rule that looks identical to the one below.

If you’d like to read detailed instructions on setting up this particular Mail Rule then make sure you read the readme.txt file located in the Install Script package.

All done!

After completing the above steps any new iCal invitations sent from an Exchange server will automatically be converted to the right formats and you will never have an excuse to be 2 hours late for a meeting again!

I suggest that you test this fix out by sending an iCal event from an Exchange server to see if all is working correctly. If the fix isn’t working for you then your exchange server is probably using a different timezone format and you’ll need to read the section in the readme.txt file on customising timezone support for your country.

Caveats

• NB: Make sure you open the readme.txt file in the Install Script folder. This readme file contains important information which isn’t included in this post.
• This fix has only been tested on Mac OS X Leopard 10.5.1 and 10.5.2 and there is no guarantee that it will work on previous or future versions.
• We’ve only been able to test this fix on three MacBook Pros and while it worked on all three YMMV. We’ve now tested it on about 10 Macs now and it has worked on every one we’ve tested thus far.
• Before installing or running this fix make sure you backup your iCal first. In iCal click File –> Back up iCal… and save a backed up version to your computer.
• When you recieve an Apple iCal invitation there is a message that pops up in iCal saying that “no data was added to iCal” but when you click OK the iCal event is loaded to iCal anyway. I’m not sure why this happens with iCal but I’m working on a fix for that.
• I can’t provide support. If you want help in setting up a unique timezone regular expression then I’ll assist with that but any other queries I cant’t respond to – I just don’t have the time, sorry.

I’m going to be talking about incorporating SEO and Social Media into a company’s marketing spend and it’s a perfect topic for me as I feel very passionate about both areas. These days I find myself working with Social Media more and more but my initial passion was always search.

I’ve long felt that while Google is an awesome company and I highly respect their ethos, one company should not control so much of the world’s data. Personally I’d rather have Google own my data than say Microsoft but I still maintain vertical search is a necessity in this ever dominant market.

When I developed Grabble in 2006 I thought I was onto a winner. Sadly it never took off (it’s almost dead in fact) but what I did gain out of this project was an appreciation for search and the technologies that power it. Grabble evolved from open source Java applications, Perl and then I settled on PHP.

There’s a reason why Google have a couple hundred thousand servers collecting, storing and processing information but none of this I could understand, contemplate or appreciate until I tried doing it myself.

What’s even better than talking about some passionate topics is the fact that I’m the second presenter which takes a lot of the pressure off me to really enjoy the remainder of the conference.

If anyone is still interested in going to the conference I have a whole bunch of vouchers which give you 25% discount off the conference price. Get in touch with me and I’ll happily hand them out.

Finally I can now officially announce that I’ve left The Times and have taken up a new position as the Digital Innovation Manager at Avusa‘s new commercial applications unit known as the iLab.

The iLab was formed to create online, offline and mobile innovation within the Avusa group and I’ll be heading up a small team from this point onwards. I will still report directly to Colin, who is now the Publisher of Times Online, but he will also work very closely with us on the strategy and implementation of new products and services.

We’ve also been busy with recruiting new staff and I’m very excited that Gregor has joined the iLab, in a highly strategic role, as our New Media Specialist. We’re really going to diversify Gregor’s skills and it is without doubt that he’ll be an invaluable addition to the team.

From the 1st of April Ian Barnes will join the iLab team as our Lead PHP Developer and I’m really excited to have his skill-set on board. Ian was responsible for the development of the Vault9 network as well as the blog traffic exchange site Blog Mad, so he has a proven track record in delivering high-quality websites.

There is little doubt that we’re building up a formidable team in the iLab and we’re not done just yet. We’re still on the lookout for a killer Web/Multimedia Graphic Designer so if you want to work with an innovative, dynamic and super-cool bunch of guys then pop me an email.

Exciting times at Avusa and I’m looking forward to reporting on some of our developments in the coming weeks and months.

This is something I’ve wanted to do for some time now and once we had the standard mobile site completed, integration for the iPhone version was simple.

I think this makes us the first website in Africa to launch an optimised version for Apple’s highly successful devices but I stand to be corrected.

It is unclear how successful the penetration is of the iPhone and iPod Touch in Africa but it’s going to be interesting to see what sort of uptake we have on this new platform.

Here are some screenshots of the interface and you can view a whole bunch more over here.

This was a very interesting exercise so I figured that it might be interesting to expand on this and explore the stats available on South Africa. I’ve now created the first of hopefully a monthly report and you can view the stats in greater detail below, download the PDF version or grab some high-resolution images to use as you see fit.

Because I only had some figures from November 2007 I was only able to do a comparison of the total registered users on Facebook but this will obviously be expanded somewhat next month.

What I did find interesting (even with the limited data) was that the growth rate of registered users on Facebook only grew by 41,680 people in a three month period.

I have no official stats but I know from watching the trends in the past that registered users from SA had been growing at a phenomenal rate and this current figure tells me there is a major slow-down and possibly even a saturation in users.

As a result we dropped from #9 to #10 in the world for registered users while Turkey and France nearly doubled their figures during this same period.

I hope that this information is of value to some of you and I’d love to hear some feedback, if possible.

| View | Upload your own

If you’ve never heard of this plugin before here’s a quick excerpt detailing what the plugin is all about.

The TimesURL Sociable Plugin for WordPress gives visitors the ability to shorten urls, email, and share pages they find on your website. It works by adding icon images below each of your blog posts that, when clicked, sends your blog post details to a range of South African and International social bookmarking websites.

The plugin has matured somewhat and this important update forms part of a new structure which we’ve implemented to work with the WordPress plugin directory.

While there was an automatic update function in this plugin what I found was that WordPress’ built-in plugin update notifications only work with plugins that are contained within the WordPress plugin directory.

Version 1.3 is now compatible for use with the plugin directory and I urge anyone using this plugin to upgrade as soon as possible so that you can be notified as soon as newer versions of the plugin are available. Detailed upgrade instructions are contained within the readme.txt file.

I’ve also added a couple more South African sites for you to chose from.

Afrigator Mobile

This is the second Afrigator mobile site to go live. After we launched the second version of Afrigator we lost the functionality with version one of the mobile site but over the weekend I finalised things and our mobile application is now working.

When Scott posted this blog post I decided it was time to sort things out and we too tested a number of redirect scripts. Ultimately I found that PHP worked best for this and now if you go to afrigator.com on your mobile it will automatically take you to the afrigator.mobi site. Likewise if you’re on a desktop browser and visit afrigator.mobi you’ll be taken directly to the .com version so we are optimising the site depending on what browser your accessing the site from.

You can read more about the new mobile site here.

MyWebShots

I’ve been working with Dominique from Code Central for some time, in fact ever since he launched MyWebShots. We did some initial integration with his service and Afrigator and we’ve been using the service ever since to generate thumbnails on the Afrigator website.

In a random set of events Dominique has kindly handed over MyWebShots for me to take control. He’s got some other commitments which is limiting his time on this particular project and since we already use the service so much I guess he figured the code would be best looked after in my hands. I am so greatful to Dominique for this and thanks to 12-months free hosting from Afrihost, MyWebShots has just gone live.

The service will remain as is and Dominique and I will worry about migrating existing clients to the new domain. I’m of the opinion that the service and brand are very strong as a stand alone application and for this reason MyWebShots will remain in tact. What this does do is allow Afrigator to white-label the service and customise it to our needs. Very exciting times.

Nudjit

And finally a new gadget review site that I’ve started with Nic and Gregor has officially gone live. We figured that there really isn’t a definitive gadget review site in this country and with Nudjit we hope to change this. Ironically we’ve already received some great reviews from both Charl Norman and Paul Jacobson.

The main idea behind it was to incorporate TimesURL in an easy to use plugin for WordPress but in the end I decided that we don’t have a current, updated plugin for social bookmarks in South Africa and hence this plugin was born.

It is based on Peter Harkins’ Sociable plugin but because Peter’s plugin is so great I decided that I’d only include the following sites and make it more local by only including popular sites used by South Africans.

• TimesURL
• Muti
• Facebook
• Google Bookmarks
• StumbleUpon
• del.icio.us
• Digg
• Reddit
• Technorati

You an read all about the usage of the plugin on this page and once the plugin is activated in WordPress you’ll see the following below each of your blog posts.

The plugin has been tested to work on WordPress 2.0.11 as well as 2.3.2 and if you’re using WordPress 2.3 then you won’t have to worry about checking for upgrades as WordPress will notify you when a newer version of the plugin is available.

Because it’s a South African plugin I’d like it to be the definitive social bookmark plugin for this country. If I’ve missed any sites out please let me know.

7 months. That’s how long this Beta version took us to finalise and while it’s not completely finished yet we decided to move it onto the live server late last night.

The official announcement contains a fairly detailed list of what has changed and it would be great to get your feedback on this new version. Head on over to Afrigator and test the new system out.

It’s been a busy few weeks for me but none more than this current week. It seems as if all my efforts the last month or so have all come to a head and I’m pleased to announced the new Planet Apps portal for The Times. Planet Apps is a new site that will house all our online applications and we’ve started this portal with one new website and two Facebook applications.

TimesURL is a port of my Tiny Link project and when I showed the guys here what I did with Tiny Link everyone was impressed. After some planning we decided to port that site to the Avusa stable.

TimesURL has a cool new interface, thanks to Colin’s design skills, and we’ll be rolling this out into the newspaper as well as in other projects we have planned for next year. The integration between online and the newspaper is now seamless and we can direct people reading the paper to the exact location online with a simple 25 character url.

Prior to joining The Times we decided that a Facebook app was on the cards and it’s been on my list of todos for some time. On Tuesday I decided to finally look into doing an application for Facebook and by the end of the day I had completed two.

Developing for the Facebook API was much easier than I thought it would be and while the Facebook Markup Language took a little getting used to I’ve now got the hang of it all.

Our two new applications we have for Facebook include a News and Multimedia application. Here’s a quick breakdown of functionality for each:

News App: Displays a list of the latest news from The Times on your profile page. There is also a new icon in your left-hand navigation and when you click on it you are taken to a canvas page with all the latest news items and a blurb for each.

Multimedia App: The Multimedia application also displays on your profile page but you can actually view the latest video direct from your profile. Clicking on the Times icon in the left-hand navigation bar brings up a detailed page showing you all our latest multimedia with descriptions and images.

I’m really happy to be seeing some of our projects go live because it’s been a long time coming! Head on over to Planet Apps now and see what we’ve been up to.