Jun 18

The end is nigh for the modern graphics chip. It genuinely pains me to say that. After all, I’m an unapologetic chip aficionado, someone who loves the technology of integrated circuits for the sake of it. But it’s becoming increasingly apparent that GPUs are over-engineered, increasingly irrelevant and almost definitely not long for this world.

The background here involves a confluence of technological trends. The most ominous of these in terms of the GPU’s longevity as a discrete component is the architectural convergence of CPUs and GPUs. However, one of the most debilitating symptoms of the graphics chip’s terminal malaise is complexity – sheer, pointless complexity. Take Nvidia’s latest uber pixel pumper, the GeForce GTX 480. It weighs in at three billion transistors. That’s getting on for triple the size of Intel’s beefiest PC processor, the six-core Core i7-980X.

If the GTX 480 was any use, that monster transistor count would actually add to the allure. But the harsh truth is that it isn’t – for almost anything. And that makes it dumb. You see, despite the hype regarding running non-graphics applications on GPUs, there’s still very little outside of games that makes more than passing use of a desktop or laptop GPU. More to the point, the number of games demanding a really high-end GPU that are actually worth playing isn’t merely a small number. It’s zero.

Put it all together and you have a terminal mismatch between the cost and complexity of GPUs and their real-world utility. In truth, I’ve felt this way for some time. But it’s the apparent emergence of a radical alternative to established 3D rendering technologies that really brings home how bloated and ludicrous graphics chips have become.

This alleged revolution in rendering comes from a small Australian software startup known as Unlimited Detail. It’s not actually brand spanking new, having been in development for a year or three. But thanks to the random nature of web-based content aggregators, Unlimited Detail was lifted from obscurity recently in a flurry of YouTube-powered publicity.

Anyway, as far as I could tell the basics of this new rendering technology involve ditching polygons in favour of atomic points in 3D space. The claimed result is quite literally unlimited geometric detail. Oh, and the whole thing runs in software at smooth framerates on a conventional PC processor. The GPU doesn’t get a look in until it’s time to spit out the final 2D images.

You hardly need me to point out it all seems too good to be true. So, there was nothing for it other than to go straight to the source and speak to the guys at Unlimited Detail. The technical brains are provided by Bruce Dell, a former supermarket manager, while the business nous comes courtesy of Greg Douglas, a games insider formerly of developers Auran.

The idea of using atoms or points is not new, of course. The really clever bit in UD is the 3D search algorithm developed by Dell. The precise details are UD’s big secret. But according to Dell, “The algorithm takes point cloud data and files it in a certain way so that it can be quickly sorted and accessed.”

When the algorithm searches for points, it doesn’t do so indiscriminately. Instead, it only pulls up a single point for each on-screen pixel being rendered. “We only grab the atoms we need for each pixel, we don’t touch the others,” explains Dell. In other words, the workload depends on screen resolution, not the underlying geometric detail of the scene being rendered. Thus, an impression of unlimited geometry is created.

The UD guys claim the algorithm is so efficient it runs in real-time in a single thread on just one core of a conventional PC processor. Apparently, it will even scale down to simple CPUs in mobile devices.

So far, the only hard evidence for these incredible claims takes the form of a few pre-recorded videos of dubious quality. However, having spoken to the UD pair, I’m happy to confirm they’re not only incredibly passionate, but strike me as completely genuine. It’s potentially extremely exciting stuff.

Still, even if UD works exactly as advertised, the established players in graphics are hardly going to embrace a technology that instantly renders several decades and billions of dollars of investment obsolete overnight. You have to assume Nvidia, and to a lesser extent AMD, will resist the idea strongly. But if Unlimited Detail’s technology gains any traction at all, GPUs really will look sillier than ever.

Tags: amd, application, business, circuit, convergence, CPU, desktop, developers, Development, device, ims, laptop, Mobile Devices, processor, rms, Software, space, Technology, transistor, web, XP, youtube
Jun 17

Light is electromagnetic radiation. In particular it’s that part of the electromagnetic spectrum that our eyes are sensitive to: it ranges in wavelength from about 400nm (violet) to 700nm (red). Beyond red light we come to infrared (IR). Like ordinary light, infrared (or specifically near infrared) can be focussed by glass lenses and recorded by the CCD in a digital camera.

Ghostly colours -- if your camera is compatible

Infrared photography can be used to produce interesting ghostly effects, but all cameras are different so test yours before buying any pricey gear. (Click the photo for a high resolution version.)

By excluding all visible light from the camera while allowing infrared to pass, it’s possible to take photographs using infrared alone. White clouds can appear against an almost black sky and green vegetation comes out so white that it almost glows. The end result has been variously described as otherworldly, ethereal and ghostly.

If you don’t want to fake the effect (see ‘Fake Infrared Ektachrome’ later in the article), you’ll need to collect together a little bit of kit to do this right. First, infrared photographs usually require a long exposure so you’ll need a tripod. However, if you don’t already have one, hold off on buying one until you’ve tried a test infrared photograph. If you just happen to have a camera that’s unusually sensitive to infrared you might get away with using it handheld, but it’s unlikely. Small tripods start at about £10.

Choosing a filter

The next consideration is an infrared filter. For your first attempts at infrared photography we suggested that you use the Hoya R72 filter. Its cut-off point is only just into the infrared spectrum, which means it actually lets a small amount of visible red light through too. If you’re pleased with your initial foray into infrared photograph and want to go one stage further, you could try other infrared filters that have cut-off points further into the infrared spectrum. The infrared effect will be even more pronounced and dramatic, but exposure times will be increased.

The Hoya R72 has a 50 per cent cut-off point of 720nm. The Kodak Wratten #87 has a corresponding figure of 795nm and excludes all visible light. The Wratten #87C has an 850nm 50 per cent cut-off and this is probably as far as you’d want to go. Although Wratten filters are supplied as 75mm square gelatine sheets that aren’t easy to attach to your lens, manufacturers of screw-in filters often refer to an equivalent Wratten number.

But before you buy, make sure it’s actually going to work with your camera…

Preparatory work

Although CCDs are extremely sensitive to infrared, many digital cameras aren’t. This is because manufacturers usually put a filter in the camera to block infrared, as it would otherwise upset the colour balance. These filters aren’t 100 per cent effective so some infrared still reaches the CCD, but exactly how sensitive a camera is to infrared varies greatly. Your first job is to check that your camera is sensitive enough to be usable.

The unusually high reflectivity of grass and foliage is responsible for the unreal look of infrared photographs. (Click the photo for a high resolution version.)

The easiest way to do this is to ask a local photographic shop if you can try an infrared filter before you buy. Here we’re talking about a filter that allows infrared to pass through while blocking visible light. Remember that the light meter might be wildly inaccurate under these conditions, so if you don’t get an image on your first attempt, try over-exposing by several stops if necessary. Another option is to use a TV or DVD remote control unit, since all such devices emit infrared light. If your camera allows the LCD panel to be used as a viewfinder, view the infrared emitter at the front end of the remote on the LCD panel and press one of the remote’s buttons in a dark room. A bright dot indicates that the camera has reasonable infrared sensitivity. If you have a digital SLR that can’t use its LCD panel as a viewfinder you’ll have to try a test photograph, again bearing in mind that you might have to over-expose.

Once you’ve discovered that your camera can be used for infrared photography and bought an infrared filter, you can start to get a better feel for what sort of exposure you’ll need under various conditions. Screw the filter onto your lens and try some test shots. The exposure will be much longer than normal and could be several seconds, even on a bright day. On the basis of these trials you can decide whether there’s any chance of shooting handheld or if you’ll need to use a tripod. The other piece of information you’ll glean from this test is whether the camera’s light meter is accurate in infrared and, if not, by how much you’ll need to over-expose.

Capturing the invisible

If you’ve got this far we’ll assume that you have an adequately sensitive camera, have bought an infrared filter and have decided whether you need to use a tripod. Now you’re ready to pack your gear up and try your hand at some infrared photography. First, though, a word on your choice of a subject.

We don’t want to be too prescriptive because this can stifle creativity, but perhaps we can offer a few suggestions to get you started. Remember the unique characteristics of infrared photographs – the blackening of blue skies and ghostly white rendering of grass and tree leaves – and pick your scene accordingly. Trees in the summer against a blue sky might look quite dramatic whereas an overcast scene of a bracken-covered moor almost certainly won’t. Try looking at the work of others for inspiration – you’ll find no shortage of infrared photo galleries on the web. You’ll soon see that some subjects seem to work whereas other just don’t, and you’ll also discover that some scenes are almost compulsory for infrared photographers. Perhaps the all-time favourite cliché is the graveyard, which seems to be perfectly suited to the ghostly look of infrared.

A graveyard -- the ultimate infrared cliche

This might be a cliché, but every infrared photographer has to shoot a graveyard sooner or later. (Click the photo for a high resolution version.)

Taking a shot should now be plain sailing but there’s one possible snag – you might not be able to see anything in the viewfinder with the infrared filter attached. If you have an independent optical viewfinder you’ll be OK, but you may or may not be able to see the scene in an LCD viewfinder, depending on the camera. With a conventional DSLR the viewfinder will almost certainly be blank. If you aren’t able to see through the viewfinder, you’ll have to frame the shot before fixing the filter –so you’ll have to use a tripod.

Infrared photographs will rarely be up to scratch straight out of the camera, so image processing will almost always be necessary. First, although infrared photograph is a form of black-and-white photography, your photograph probably has some colour cast. Often the raw photograph will be in shades or red, so your first job is to convert it to greyscale. Even if the result does appear to be black and white, you should still to convert it to greyscale to ensure accurate blacks and whites. Then, because high contrast is often important in infrared photography, you might decide to exaggerate it by artificially increasing the contrast. Ensure you only ever edit a copy – leave the original intact so that you can try something different later if you want.

Infrared colour photography

Infrared is normally considered a form of black-and-white photography, so infrared colour photography sounds like a contradiction in terms. However, it’s possible to create a photograph that contains some colour information yet has the tonal quality of an infrared photograph.

First, take a pair of photographs of the scene, one in infrared and the other normally in visible light. This means that the camera must be mounted on a tripod and that nothing in shot is moving. It’s also important to use the same aperture for the two shots so that the depth of field is the same. Try to work as quickly as possible so that the lighting or slow-moving clouds don’t change much between the shots. You need to add or remove a filter between shots and probably alter the exposure, which could be tricky. It’s a good idea to give this process a bit of thought before trying it out for real.

Process the infrared photograph as already described for ordinary infrared photography. Now, using your photo-editing software, split the ordinary photograph into either the HLS (Hue, Lightness, Saturation) or HSB (Hue, Saturation, Brightness) channels – the two are slightly different so try experimenting with both. Splitting channels is a feature of most fully featured photo editing packages, although it might be absent on entry-level products. Each channel appears as a greyscale image, of which one – lightness or brightness – defines the lightness. Since we want to impart the tonal qualities of an infrared image, discard the brightness or lightness channel and put the infrared image in its place before recombining the channels. The result should be quite an eye-opener.

A colour shot combined with an infrared one gives a striking effect

Combining an ordinary photograph with an infrared shot can create dramatic colour effects. (Click the photo for a high resolution version.)

This is just one way of creating a colour infrared image and the possibilities are limited only by your imagination. Here’s another method that has been widely used, but be aware that the exact result will differ from one camera to another – so you might end up with a different effect entirely. And if the infrared image as it comes out of your camera appears black and white this method won’t work at all. Take an infrared photograph but, instead of converting it to a greyscale image, use your photo manipulation package to correct the white balance. Although the colours won’t be correct it will result in some parts of the photograph coming out almost white instead of shades of pink. The sky will appear red or brown, which looks most odd. To correct this you need to use the channel splitting and recombining trick. But instead of splitting to HLS or HSB, split the photograph to RGB (Red, Green, Blue) and then recombine with the Red and Blue channels swapped. With a bit of luck you’ll end up with a blue sky, while any foliage will have a slight sepia hue to its ghostly appearance.

Fake an infrared photograph

For many, the appeal of infrared photography is that it’s a natural phenomenon that can’t be recreated by digital wizardry. However, if you don’t want to shell out on an infrared filter you can get a similar (albeit less dramatic) effect using image-processing software.

Take an ordinary colour photograph and make sure it’s one with a really dark blue sky and light, well-lit foliage. Using your photo-editing software, split the channels to RGB and then discard the blue channel, recombine the remaining two channels and convert to greyscale. This will have the same effect as putting a red filter on the camera – it darkens the sky but not as dramatically as happens with an infrared filter. The glowing white appearance of the foliage will be absent, though, so let’s try something different. Again split the colour photograph to RGB and discard the blue channel. Before recombining, though, try increasing the brightness of the green channel. Now when you recombine you’ll find that the foliage has become lighter but, because all but the darkest azure blue skies contain some green content, the sky won’t be as dark. A degree of trial and error is required to find a compromise that comes close to the genuine infrared effect.

Simulate infrared ektachrome

For many years Kodak produced a film called Infrared Ektachrome, which produced a colour infrared image. That image was very different from the colour images we’ve discussed in the main part of this article because the film was intended for scientific rather than artistic purposes. Nevertheless, some mainstream photographers did experiment with it for its novelty value, and it’s quite possible to emulate it digitally.

An ordinary colour photograph is made up of images in the three primary colours – red, green and blue. Infrared can be though of as another colour so Infrared Ektachrome recorded an image in three alternative primary colours – infrared, red and green. Because our eyes can’t see the infrared, each primary colour was translated so that infrared appeared as red, red as green and green as blue. Because our eyes can only handle three primary colours, blue was discarded by putting a yellow filter over the lens. This combination of infrared and colour was used in aerial photography because it showed up features than couldn’t be seen in visible light alone. Normal crops, for example, appeared red because they’re highly reflective of infrared whereas diseased crops looked blue because they only reflected green light.

Faking Ektachroms is relatively simple if you split the right channels

A different way of combining a visible and an infrared shot gives results reminiscent of Infrared Ektachrome film. (Click the photo for a high resolution version.)

To create this effect you need to take a pair of photographs, one in visible light and one in the infrared and combine them in a photo manipulation package. This time, however, split the visible image to RGB, discard the blue channel and recombine with the infrared image in place or the red channel, the red in place of the green, and the green in place of the blue.

Near and far

Infrared photography is often thought as a means of seeing in the dark. But the far infrared radiation (or heat) emitted by living creatures, is recorded. It’s also possible to use near infrared to photograph in the dark, but because most objects don’t emit near infrared you need a source of infrared illumination. A flashgun with an infrared filter over it will do nicely.

Although many insects can see ultraviolet, few creatures have vision that extends into the infrared. Research has suggested that birds of prey can see longer wavelengths than humans, but they probably don’t perceive this near infrared as an extra colour – so you have the potential to capture scenes that no living creature has ever seen.

Tags: camera, device, information, lighting, photographs, Research, rms, sla, Software, web, XP
Jun 16

And so it happened: on 28 of May, I entered the realm of the fanboy. Early morning saw me queueing outside the Apple Store in Bath, eager to get my hands on one of the first British iPads. As the utterly incongruous whooping and hollering began to emanate from the bowels of the store – and those in the queue looked around sheepishly, hoping they wouldn’t be expected to HIGH FIVE! – we knew we were just seconds away from the doors being thrown open to… yet more queuing. This is how these things tend to play out. It was a bit crap, really – especially considering that over the following few days, I couldn’t move for sodding iPads. Still, unfounded fears of gadget scarcity aside, what the queuing did reveal was a serious amount of excitement about a bit of kit that most of the assembled shoppers hadn’t even played with yet. iPad fever appears to have landed in Blighty, too.

For the past few weeks, I’ve had to listen to gushing accounts from our American cousins about how great the iPad is (as well as a few crowing importers who couldn’t wait to experience the joy of Apple’s new device). At last, I can finally make a few observations based on more than blog posts and Twitter witterings myself.

1. The iPad is going to be huge!

I’m not really saying anything new here, but there were reports that claimed the iPad wouldn’t resonate with the British. Simpson Carpenter’s qualitative research concluded that the iPad “won’t be mass market in the UK”. ‘Mass market’ is a very vague term, but the report did get more specific, claiming that “the iPad will take longer to achieve the sales growth and wider market impact of the iPhone”. My qualitative observations don’t quite reflect those of Simpson Carpenter. For instance, the last time I visited an Apple Store, around 100 people were assembled around the iPad display area, leaving the flashy new MacBook Pros feeling like Woody in Toy Story! The people responsible for this research may need to rethink their esteemed judgement, given that the iPad has already pushed past two million global sales.

2. March of the web apps

The iPhone’s big story was the sheer number of apps you could download from the App Store, which was perfectly summed up in Apple’s ‘There’s an app for that!’ marketing campaign. But I think the iPad’s 1,024 x 768 pixel resolution will provide a great canvas for developers wanting to create web apps that utilise the strengths of the next generation of web standards, such as CSS3 and HTML5. The iPad version of Safari doesn’t have full support for these technologies just yet, but you can see some great examples of what it does support.

If monetisation isn’t your primary focus, then the simpler development route (using web standards, rather than Cocoa Touch) and cross-platform support should see a big increase in optimised web apps. Gmail is already optimised for the iPad, but there are still issues for developers: take Google Docs, for example. As things stand, Safari for iPhone OS does not support ‘contenteditable’ (which is used to enable text input within a styled element), but contenteditable is an integral part of the code that powers Google Docs (and many other web apps). Bummer! There are claims that version 4 of the iPhone OS will support contenteditable, and this will be an important addition – requirement, even – if web apps are to take off in earnest on the iPad.

Is the iPad a laptop replacement?

No. It’s already become patently obvious to me that trying to execute certain processes just doesn’t work on the iPad. Tasks such as heavy word processing, and any editing job that requires precision mouse control, are severely limited by the iPad’s design (and the need to navigate the device using a chubby skin stylus, otherwise known as your finger). But what you have in the iPad is a perfect bridging device: one that enables you to take care of day-to-day tasks for which a laptop has become overkill. Watching videos, playing games, checking email and browsing the web no longer require a laptop, and the iPad looks set to launch a new wave of optimised sites and apps that address the challenges of designing for gesture-based tablets. It’s only once you’ve had the device in your possession for a while that you begin to realise the impact it could have on the development, design and consumption of digital media.

 

Tags: Apple, apps, blog, developers, Development, device, email, gadget, generation, google, ims, iphone, iss, laptop, marketing, patent, requirement, Research, web, XP