Yep, it’s just happened to me. Years working on the idea of the ‘Wisdom of Crowds’ (even prior to web 2.0 in the shape of Red-Piranha). Month’s working on a Masters Dissertation on applying Web 2 techniques to the Finance industry (pdf link). And somebody comes out and does it even better.

Not just better. But much much better.  The sort of better as in ‘If I had this earlier, I’d have just copied it and changed the words around a bit’. The book is available from Manning as ‘Collective Intelligence in Action‘. A free, first chapter (Understanding Collective Intelligence) is available here (pdf).

So what’s it about? We’ve all heard about the Wisdom of Crowds idea. But what if you need to actually implement it on your website? This book shows you how to (using both concepts and practical code, as well as the theory behind all of it that I was missing). It includes

• Intelligent, learning search, using Lucene.
• Extracting data from blogs using web-crawling.
• Executing Real time feedback on facebook-like sites.
• Scalable data-mining techniques to manage the torrent of information
• Making personalised recommendations based on all of the information.

Disclaimer:Manning provided me with a free review copy of the book – but no strings attached. And , maybe if I’m nice enough to the Author (Satnam), I can persuade him to talk about making millions using JBoss Drools and Complex Event processing in the book.

1. If you’re in business you need computer systems to support your team. Systems to find previous dealings with a customer, systems to allow your team to work together, systems to stop people finding out things that they shouldn’t.
2. Once your business passes the 100 employee mark and is heading for ‘Enterprise’ scale, chances are you need custom software written just for you, in addition to he ’shrink wrap’ stuff you’ve been able to get away with until now.
3. Most custom Enterprise software is written in (or uses a large element of) Enterprise Java.
4. Enterprise Java is hard to get started with – it’s a big and complex framework because it solves big and complex problems. The Spring framework makes it easy.

OK, so we’re Spring nuts. But nuts only because it’s solved problems for FirstPartners over the last 4 years. What we like:

• Spring allows you to use just enough Enterprise Java to solve your problem
• Spring complements Enterprise Java, not replaces it.
• Spring gives you a gentle slope to using Enterprise technologies.
• Spring works well with Java, Oracle, .Net , (J)Ruby and pretty much any mainstream technology – including most of the widespread Java Frameworks like Struts and Hibernate.

So you wait ages for one Spring Event in Ireland, then two come along at once. We’ve written about Rod Johnson speaking in Dublin on Tue March 11th. Now there is a full day Spring Event in Belfast the day before (March 10th). And it’s sponsored by Momentum NI, so it’s free. And the Hilton Hotel is right beside Belfast Central train station, so it’s easy to get to from Dublin.

The full agenda is here (more details below), but given the importance of Spring to the Enterprise world, and the fact that the top four Spring guys are speaking, we reckon that it the Enterprise event of the year. The booking form is here.

Spring Ireland 2008

Start: 10th March 08:30 End: 10th March 17:30
Hilton Belfast, 4 Lanyon Place, Belfast (Beside Central Train station) SpringSource is proud to announce Spring Ireland 2008. Join us for a free one-day conference with presentations from the SpringSource team including a keynote from Rod Johnson.

Keynote: Spring into the Future – Rod Johnson

The Spring Framework began in 2002 with Rod’s best-selling Expert One-on-One J2EE Design and Development; one of the most influential books ever published on J2EE, Rod is recognised as one of the world’s leading authorities on Java and J2EE development.With the rapid expansion of SpringSource and move to new corporate HQ in Silicon Valley, this is a rare UK opportunity to hear Rod provide his views and explore the future of J2EE application development.

What’s New in Spring 2.5 – Sam Brannen

Sam is a lead architect at SpringSource and one of the most experienced developers within the organisation.This session provides delegates with an overview of the new features available in Spring 2.5. Specifically, highlighting the simplified and extensible configuration support provided via configuration annotations and new XML configuration namespaces, new Java 6 support, updates to Spring AOP, improved JDBC and JPA support, annotation-driven web MVC controllers, the new annotation-based TestContext framework for unit and integration tests and more!

SpringSource Professional Services – Greg Southey

Greg has built SpringSource’s UK Professional Services organisation into the leading Spring consultancy business in the world.

This is a brief resume of some of the 97 major projects completed by the UK Professional Services team in 2007. Delegates will hear about the business drivers behind some major development projects, the business issues faced and how they were resolved in partnership with the client.

Spring as a Full Stack Web Framework – David Syer

As Principal Consultant at SpringSource, Dave leads the way in the understanding of satisfying business requirements using the Spring Portfolio. His easy manner cloaks a prodigious knowledge of application development.

This session explores the “full stack” web framework trend and answers the question: how does Spring stack up? This session defines what a full-stack web framework is, then provides a fair technical comparison between a Spring-centric web development stack and the alternatives. Delegates will head about the feature-set of modern “full stack” web frameworks, and what Spring has that differentiates itself from the pack.

Spring in Ireland – Ian Graham

Ian Graham, Momentum, will explore the use of Spring in Ireland and introduce case studies from companies who are using the Spring family of products.

Round Table Discussion – Rod Johnson, Rob Harrop, Dave Syer, Sam Brannen & Greg Southey

Your chance to ask Rod and his team anything that’s on your mind regarding Spring!

Assuming no new properties are listed and properties continue to go Sale Agreed/Withdrawn at the current rate then there is currently 11 months supply on the market.

Wonder what EastMeath.org makes of it all?

If I wasn’t in IT , I’d be in Finance, on the basis of …

• My original degree is in Business (with French). Somehow I got seduced into IT (you don’t hear that very often).
• Both Finance and IT require their own set of knowledge and expertise. Once you’ve acquired that expertise, the work can be quite profitable, as not everybody can do it.
• Both are quite strong employment areas within Ireland, with the IFSC being one of the easiest parts of Dublin to get to from Drogheda (think Trains).

Sadly (but very sanely), neither Finance nor IT is considered ’sexy’. There again, you can’t have everything. They’re both quite hard to explain to your Mum – as far as she’s concerned , I work ‘in computers’. This is akin to lumping Salesmen , Mechanics, road sweepers and Michael Schumacher in a category ’something to do with cars’.

However , this lead-in does explain the contents of the ‘what’s Paul Reading?’ list. All links are to Amazon. I’d recommend all the books with the exception of the last one – it was written by a newspaper journalist and the slightly jingoistic style reflects this.

1. Economist : The City – a guide to London’s Global Financial Centre
2. Freakonomics
3. Java security
4. How the City Really works

So for Dolan and Company / CMR Accountants to get the honour of being critisied in public, they must have behaved pretty badly. Yes, they’re the ones located at the Steelworks in Foley Street Dublin (near Busaras, Connolly Train station). They’re now our Ex-Accountants, for reasons that will soon become clear.

Dolan and Co were our company accountants from Dec 03 until Mar 06. We’re not the biggest of companies. Our accounts could probably be done using Excel by somebody with a Leaving Certificate qualification. We prefer to subcontract rather than employ people, so that makes our accounts even easier.

So what have Dolan done to annoy us so much?

Overcharging. We had a set monthly fee for their services, paid by direct debit. Easy enough? Even if a mistake was made, it shouldn’t be too hard to sort out. Well no actually. During the last 15 months of our arrangement, I spent more time on the phone to Dolan / CMR about the fees than talking to them about the actual accounting service. While I wasn’t happy at the end, Dolan agreed to refund me a set figure in March last year and I moved to another accountants.

End of story, or so I thought. Not nice, but not enough reason to blog about it.

Ok, so how have they really annoyed you?

The basic reason to have an accountant is to file accounts with the Revenue Commisionars (Government Tax Department). These accounts / reports are (i) How much money you take as Salary from the business and (ii) How much VAT you owe the Government (based on your Sales).

Not surprisingly, the government takes a very dim view if you don’t file these accounts / reports on time. Fortunately , they’re easy enough, so long as you keep on top of them. For example, you can pay your Tax every month by Direct Debit. At the end of the year, you file a final report and pay any (small amount due).

Here’s the problem. For 2005 , Dolan / CMR set up a the Direct Debit but did not make the final report. This is despite assuring me that that the return had been made when we signed off the accounts at the end of the Year. (You know who you are). While I do not owe any tax (because we paid by DD monthly), the Revenue are entitled to fine me several thousand.

My new accountants say it will take them about 5 minutes to complete and post via the web (the ROS.ie website).

I will accept a large part of the blame for this – after all it is me , not the accountants, that they Revenue Commissionars will chase. But if you (a) are paying a professional service company to do work and (b) they tell you that this (basic) work has been carried out, would you not be annoyed to find out that it hadn’t?

I’ve left the comments section open for Dolan / CMR to reply if they see fit.

Thanks to Martin Boylan and Co (Drogheda) , our new Accountants, who are helping tidy up this mess.

These business people would be happy to run their organisations on Spreadsheets. Do you remember the cartoon where Dilbert convinced the pointy haired boss that he could fly the plane using Excel? There’s more than a element of truth to this. I know of at least one US Fortune 100 company that (until recently) conducted most of it’s operations on little more than Microsoft Office and duct-tape. It worked, not very well, but it worked.

Until now , the next line would be ‘Excel (or any other type of Spreadsheet) is not secure / scalable / sharable / not web friendly’. That was until Google launched their Docs and Speadsheets. It’s an online version of Office with some spreadsheet functionality. Play with it a bit and you’ll see that there’s plenty missing. But this being Google , I’m willing to put good money on

• (a) new features rolled out (think steamroller) and
• (b) These Spreadsheets being massivly scalable / secure / sharable.

This being Google, there is also an API (developer page here). It’s got massive holes in it (e.g. you can’t yet use it to create a new spreadsheet). But when Microsoft bring out their version of online spreadsheets (and they will) not only will they clone the Google API (to get market share), they’ll need to go one further and introduce new features / remove the usage restrictions in order to compete.

So, secure, scalable, sharble online spreadsheets are here to stay. So lets take a look at Mr. (or Ms.) Pointy haired boss thinking about their new project:

1. Hmm, I think we need to be able to gather which health plans our employees are enrolled in.
2. OK, I’ll throw together a spreadsheet to show people what I want
3. Before I’ll give to our friendly Java developer and let him ‘do’ a website from it.
   Soon I’ll just share this on Google.
4. Great , Loads of people are now using it, I’ll just the (Ruby / PHP / Insert other language here) guy to add one or two extra features.
5. Most Excellent. Why don’t we spin this off as a Web 2 company and sell it to EBay??

There you have it, Massively scalable , Highly secure websites (see Google Authentication API), without needing to know anything about EJB, JMX , JBoss, JDBC or any of the hard won knowledge that us Enterprise Java Developers have built up over the last 7-8 years. I’m exaggerating, but not much.

What do you think? Is Enterprise Java dead, or is Web 2 just another boost and a slightly different way of doing things for us Java people?

Other Java Posts from Technology in Plain English

Some other notes:

• Java is read once , run almost anywhere. The ‘Almost’ is because (for various technical reasons) the difficulty in getting reasonably priced web hosting. Have your tried getting some recently – impossible to find , or at least impossible to find at the prices PHP and Ruby guys can get theirs?
• Tim O’Reilly with was right with the notion of Web 2.0 and the network as a computer. We’ve also written about the notion of online software being at a tipping point.

This article was originally published on the O’Reilly books OnJava Website.

This is fantastic – you’ve got a massive free loan. Best of all many of these IOUs will get lost behind the sofa or eaten by the cat so you’ll never have to pay them back. Free money. The situation is not so absurd as it seems : The 50 Euro note in your pocket is an IOU from the Irish (and other European) governments. Technically we can reclaim payment, but what would be paid in?

What has sparked this ‘free money’ post is the news from the Financial times is that the Euro has edged out the US Dollar as the international IOU of choice. Given that the Irish Government is allowed to issue a fixed percentage of the Euro in circulation, the Irish Government now has even more money in it’s coffers ahead of the next election.

Fast forward to 2006 and these ‘heavy’ applets have been replaced by light web pages using Ajax and Flash, which don’t require a user download to run. Pretty much anything a Java Applet can do can be done in Ajax (if you have enough time and patience). Ajax developers have been pretty inventive in using Flash to solve problems (e.g. allowing web pages to store information on your local PC), so it may only be a matter of time before this gets picked up.
It’s ironic then, that the very technology that is meant to replace it , ends up giving Applets a new lease of life. It won’t suit everybody or every problem. An ‘ideal’ problem for this to solve is where the user interaction, business logic or security requirements are at the ‘higher’ end of the scale. While you could solve it using Ajax (basically javascript on steroids), using Java Applets and having a nice IDE to develop and solve your problems in may pay off in the long run.

Jan of Trampoline Systems explains in more detail.

Obviously , these rules need to be stored somewhere. Most large organisations are comfortable with the idea of using a Database such as Oracle or Sql-Server to carry out this task. This article , for version 2 of Drools but also applicable to the latest release, shows you how to use a database to store your business rules.

Can’t make it along in person? We’re going to do a 2nd Java meetup, but in a ‘virtual pub’ for people who find it hard to get to Dublin. We’ll still carry on with the existing (face to face) meetups. As an extra, at 7.30pm the last Tuesday of the month we’ll have an open chat session (We’ll setup chat software on this or another website).

So, for 7.30pm on Tuesday 25th July I’ll be online. We’ll start with ‘What technologies should I be learning in the next 12 months?’ and let things develop from there.

• Gets information from users over the web
• Does some business processing on that information
• Saves the information in a database.

At a conservative estimate , about 99% of Enterprise systems would fall into this category.

If so, why do you need an architect , when you can use our ‘one size fits all’ architecture diagram (below)?! Most non-trivial systems, regardless of the language they are written in (be it Java, .Net , or your language of choice) follow the pattern seen in this diagram.

3 Tier Enterprise Diagram

There are 3 Pieces to the Solution:

• Web Browser (for the user / client).
• Web and Application Server – carry out business logic.
• Database Back End – to store data and ensure data integrity.

Within the Application Server (the middle bit above, which as Java Architects is the bit we are interested in), there are a further 3 tiers

• A Presentation tier (or layer), which is mainly about talking to the user (it gets and sends requests to the web browser).
• A Service layer , which is mainly about talking to back end such as databases, legacy systems (such as mainframes) and XML-Web services that we may use.
• A Business layer, the ‘meat’ of the sandwich, where the ‘Value add’ is in terms of business processing and validation.

For each of these layers , your priority in building them are slightly different.

• The Presentation layer is the bit the user sees. You want it to be fast and give a good impression to the client. Underneath, use a standard framework (link: pick your framework here) and then customize the look and feel.
• The Service layer you want to work fast and well (e.g. no data faults), but then then forget about. Unless things go wrong, no user is going to complement you on the quality of database persistence! Use standard libraries for the entire layer.
• Unless your company is a clone or franchise, the business layer in the system is going to be completely different. Aside from the user-interface , concentrate most of your project effort here as this is the core of what system does. We’ve written quite a bit about how to increase the value-add of the business layer (link to O’Reilly Technical Articles)

By the way , we’re only half-joking about the ‘why do you need an architect’ bit. We can be contacted here.

1. Know what you want and stick to it. If you’re building a house and change the plans several times the builder is going to fleece you, no matter how low the initial quote was. The same goes for IT Projects – if you change your mind after the price is agreed, you’re going to pay more.
2. If you don’t know what you’re doing , find a friend who does. I know very little about houses, so when I was buying my own I got a friendly surveyor to check it out. With IT projects, this ‘friend’ should be genuinely on your side, and have something to lose (e.g. financial or reputation) if things go wrong.
3. Little and often is better. Like exercise, smaller projects that deliver results little but early are best. If the results are good, try a second (and third) round to add more functionality based on the feedback from users.
4. It’s been all done before. Tailored suits cost a lot more than ready-made ones – and most people are happy with a ‘Good enough’ instead of ‘Perfect fit’. There are literally thousands of ‘off-the-peg’ computer systems out there ready for final alteration to what you need.
5. If you don’t understand the answer, ask more questions. Thankfully the days we sat and nodded at the Doctor’s Latin words are long gone. IT Consultants may sometimes speak a different language, but if they can’t explain what they’re talking about in English that you understand, the chances are they’re trying to hide something.
6. Don’t build on sand. Like houses , projects need good foundations. For IT Projects , the good foundations are sound knowledge of the Business Processes being coded into the system. Changing processes and changing IT systems at the same time is like building on sand.
7. Sometimes the tortoise wins the race. Unless your entire business model is built around being the very first to market, then being a tortoise and letting others race ahead has very big advantages. Not only can you learn from other people’s mistakes, but the chances are you’ll get it at a much reduced cost – For example websites now cost a fraction of what they did during the dot.com boom.
8. Use a safety net. When building houses, often the first thing to go up is scaffolding, for safety reasons. The equivalent safety net in IT is called ‘Unit Tests’. Not only do they help you get there faster, but they let you know if you’ve broken something you’ve already built.
9. Be a good poker player. Good poker players never give away valuable cards. For IT projects, owning all cards mean just that – make sure that you have full rights to the solution so that you can still move tables and use a different supplier. Even if you never make the move, knowing that you can is an effective bargaining chip.

And finally …

When you are in a hole, stop digging. The decision to call a halt to the projects was no doubt a difficult one, and is to be applauded. Too often, the temptation is to keep on going and hope things will turn out right. Recognising problems at an early stage means there is more chance of being able to fix them.

• Paid about 400 Euro to get a legitimate copy.
• Got a copy from a ‘friend of a friend’.

While I’m no advocate of Microsoft, I think the 2nd option is wrong. It’s illegal and it’s theft by another name – either you want Microsoft Office enough to pay the money, however outrageous,
or you don’t and you have free choice to walk away. It’s also stupid, as there are good, low cost (or free) alternatives out there.

Some alternatives to Microsoft Office are listed below (and this ZDNet article lists some more). Given that most users only scratch the surface of available features, each of these is a ‘good enough’ replacement for Word, Excel , Powerpoint and in some cases , Access.

• StarOffice - from Sun Microsystems , available for about 50 Euro.
• OpenOffice - an open version of StarOffice , slightly more ‘techie’ but available for free.
• ThinkFree - an alternative to office that runs within your web browser (like Internet Explorer)

Why are these so much cheaper? It just shows how much profit Microsoft is making from it’s Office suite when products of a similar quality are available for a 10th of the price.

So should you switch? Realistically , you have 3 options:

1. If budget is important and you as a decision maker can push through the implementation, then go for either Star Office or Open Office. While these have every feature users need, they look just slightly different. If you can encourage users to give them a try for the first few days, then they’ll never want to go back.

   An example (heard 3rd hand) was a well known hospital in Dublin that tried , and failed to switch. The problem was that senior officers did not want to make the effort to change.

2. If budgets are not a problem or if you use the extremely advanced features like macros, then stick to Microsoft office. If you don’t know what a Macro is, then chances are that you are not using them.
3. Keep on using your illegal copy. You might have got away with it until now, but expect Microsoft to come after you as their (previously spectacular) revenue growth comes under pressure.

Go for either Option 1 or 2. For Option 3, expect Microsoft to offer increased incentives for employees to let the cat out of the bag, as well as new technical initiatives (building on the ‘Genuine Windows’ program to sniff you out. You have been warned.

As a co-incidence, an article I wrote for O’Reilly shows just How to build
an automated Stock and FX trading system.

If you’re looking for a system to make you millions playing the stock and
foreign exchange markets while you sleep, my contact details are above!

Why? Well over the years we’ve learnt a lot of lessons of how to build Scalable Java applications. Even then, some people can’t seem to get it right (No names , but you know who you are). How would SAP people (who I have a lot of respect for as you don’t get to the position SAP is within the industry without getting at least something right) react to this strange new Java world. Would they shed all past baggage and dive in with the enthusiasm of College Graduates? Or would they take a ‘not invented here’ attitude and hack together something in Java along the lines of what they were used to.

I suspected the latter , and fully expected to end up cleaning up some mess of a CRM or ERM system. However, I am pleasently surprised with SAP’s Java Website. On a pure Java level, it approaches the efforts from Oracle , IBM and BEA. If SAP are making this amount of effort to promote Java best practice, then there may be hope after all.

Final question: If this goes the way SAP is planning, at what point does it’s installed base get counted as part of the Market share of J2EE servers. What percentage of the market would it have? A healthy and very profitable 10%? Certainly the strategy (and the Market share) is very close to Oracle , which also bundles it’s (10g) App server with it’s main product (a Database rather than a CRM or ERP Solution).