Posts Tagged ‘Color’

DIY Wallpapering

Thursday, December 18th, 2008

PSP_009717_2545 One of our blog readers asked about the wallpapers we post on our website for some of our released images. If you haven’t seen these, they’re linked over on the lower right of pages like this. Many different sizes are available, from 800×600 all the way up to 2560×1600 (for lucky people with ginormous monitors), so you can choose the right size for your screen resolution.

Our masterful web master creates these wallpapers for each of our weekly captioned releases (these are the images we release each week with some commentary written by the science team). He picks out an interesting area from each image and produces custom cutouts in different sizes. We provide these extra files because we think the images are so beautiful, everyone should have them on their desktop. :) Because they’re all done by hand, though, we unfortunately don’t have the resources to make these special products for every single image. For example, most of the 1,642 images we released in our big December PDS release don’t have wallpapers. However, you can make your own, and here’s how!
(more…)

Tags: , , , , , , ,

New, Improved Color

Thursday, April 10th, 2008

Today, our software group provided a set of major updates to our downlink operations team. It was the first major update in many months. One of the most anticipated features is smarter “stretch” algorithm for our color products (RDR Extras). As discussed in a previous post, a stretch (in image processing terms), is a mapping between one range of pixel values and another. In our case, it provides our viewers with a better-looking image up-front, with less need to adjust parameters in display software such as IAS (though this is still often very helpful when zoomed in). As always, the full range of original data is preserved in the RDR JP2.

Our former algorithm for the NOMAP and Quicklook products said that the pixel values above the brightest 0.1% and below the darkest 0.1% would be mapped to the extreme values, with a linear fit in between. For a majority of images, this was a good choice that showed excellent contrast but prevented too much saturation.

However, 0.1% (a thousandth) of a two Gigapixel image is still two million pixels. So if there were a particularly bright spot, like a rocky outcrop amid a field of dunes, or a particularly dark spot, like a cavern opening in a plain of boulders, then all the saturation would occur in that one area, washing it out completely, and lowering contrast everywhere else in the image. So the algorithm needed to be more adaptable. After a good deal of experimentation, the algorithm we settled on looks at the brightest and darkest pixels in a thumbnail version of the image, and uses those values for the extremes, instead of the values at 0.1%. We shrink a copy of each color band to 1/11th the original scale. Pixel values in the original below the darkest in the thumbnail are mapped to pure black, while pixel values above the highest are mapped to pure white. The stretched bands are then merged to make the color image. Hence, a bright or dark spot smaller than 1/11th x 1/11th of the image size will no longer dominate the stretch.

What this ultimately means is, our RDR Extras now show more detail in areas that would be completely washed out by the old algorithm.

For example, in this ‘cave’ image, the left is from the original RGB.NOMAP.JP2, while the right is the same product using the new algorithm. As you can see, previously you could not tell if there was a floor to the hole or if it sloped away to greater depths.

psp_005770_1745_rgb_crop.png

The new algorithm is used strictly for the JP2’s; the browse and thumb are already scaled down enough that it would not make a substantial difference with them. The new algorithm went into effect today; coincidentally we just started orbit 8000. Images with the new stretch will likely appear in upcoming weekly releases and we plan to reprocess everything with this change (and improved calibration) during the summer.

(more…)

Tags: , , , , , , , , , , ,

Festival of HiRISE #1

Friday, March 7th, 2008

If HiRISE is like, well, a high rise, then each orbit range is a floor. The thirteenth floor consists of observations in the range 1300 to 1399. These were our first images of Primary Science Phase.

Click the link below to view a gallery of 50 HiRISE images in the 1300 range, drawn from our online PDS data node. The RGB browse is shown in the window, linked to the full JPEG 2000 using the IAS viewer. The RGB browse scale image is usually scaled down by a factor of 8–in both horizontal and vertical directions–from the JP2 product. So the browse image shows you around 1/64th of the color data: there are vast and beautiful scenes that can only be seen in full by zooming in with IAS. Nevertheless, if you have some time, this is a good way to explore a set of images and get an overall idea of what there is to see.

View Images

Most images are several times taller than your computer screen, so make sure to scroll through each one. Let us know which images are you favorite via the comments form below.

Updated (2008-Apr-10)

Tags: , , , , , ,

Coregistering Color

Friday, February 29th, 2008

As described in a previous post, HiRISE color images are made by combining images in three different wavelengths of light, infrared (IR), red (RED) and blue-green (BG). The incoming light from the surface of Mars is separated by a filter into these three parts of the spectrum. The detectors that receive those wavelengths of light then build up the three separate images of the same place on the surface. The IR and BG detectors are above and below the RED detectors in the HiRISE focal plane, so they are imaging the same place, but at slightly different times. In order to create the color products, the three separate images have to be stacked one on top of the other. Lining up these images perfectly with each other is called coregistration.

This process seems simple in concept, but in practice it is quite complicated. There are three factors to account for:

  • Relative timing
  • Pixel binning
  • Spacecraft jitter

First of all, HiRISE nearly always uses different resolutions for each color. For instance, RED might be at a scale of 25 cm/pixel (bin1) while IR and BG are at 1 meter/pixel (bin4). This “binning” minimizes the amount of data that has to be sent back to Earth, which is the most important constraint that HiRISE needs to deal with. Another reason for binning color is to improve the signal-to-noise ratio (SNR). This means that you can get a better signal by combining pixels at the expense of spatial resolution. In order to get the binned IR and BG images to line up properly, they must be enlarged to match the dimensions of the RED image. For example: RED is bin1, IR and BG are bin2. The RED image will be 2000 pixels wide by 40,000 pixels long (for example), the corresponding IR and BG images will be 1000 pixels wide by 20,000 pixels long. So the first step is to make the dimensions of all three images match.

Now the relative timing is easy to take care of. The start time of all images is a known quantity, and does not change from image to image. We know exactly when the BG detector starts imaging, followed by the RED detector, followed by the IR detector. So the beginning of each image is offset by a fixed amount. Once the images are shifted by this fixed offset (accounting for binning), they will be approximately lined up.
PSP_004230_1080

This brings us to the third factor in coregistering images — spacecraft jitter. Because HiRISE is imaging at such a high spatial resolution and at great speed, tiny motions of the MRO spacecraft cause slight variations in where the surface features appear in each of the three color detectors. Imagine that HiRISE is taking a picture of a 1m sized boulder on Mars. If the rock shows up in line 100 of the RED image, and we have already accounted for the relative offsets of the detectors and for binning, then the rock should also show up in line 100 of the BG image. But say we look and it is actually in line 99. Now when we try to stack the two images, the objects in them won’t line up exactly. Our color processing software corrects for this by holding the RED image fixed, and adjusting the corresponding BG and IR images to match it precisely. This is not a perfect process, but most of the time it works extremely well.

Producing the color HiRISE products is not a trivial process. But it is to a point where the processing is automated so new data is released without delay. Enjoy the colorful view!

Tags: , , , , , ,

Everywhere You Look

Thursday, December 13th, 2007

On Friday, HiRISE released over 1200 color observations. This was our first large release of the color products (not counting the 140+ images of MSL candidate sites released back in October). I was asked recently if our images look fairly similar to one another, or if they are all completely different. Well, you can now judge that for yourselves, but I feel the answer clearly tends toward the latter. The variety of terrain types on Mars is wider than you might have expected, and everywhere you look you’ll find something spectacular.

But I’d like to showcase one image in particular. Within this single image, there is a remarkable progression of landforms, in a view running down a small portion in the interior of Valles Marineris, the “Grand Canyon of Mars.” Here are a selected set of sub-images from the RGB color product; each thumbnail links to a larger view. All of the original products are available at our website.

At the top of the image is a flat, cratered plain, very much what one thinks of as typically Martian. The edge is abrupt, leading immediately to a steep descent crossing multiple layers of bedrock. The accumulating aprons of debris are channeled down between rocky ridges.

A number of boulder tracks are visible, remnants of mighty tumbles. You can follow one of these tracks for something like a kilometer down into the middle portion of the image. Here is a small part of this track.

PSP_003355_1665_RGB-0

Farther down, a network of scalloped terrain has formed in what must be a transition zone from the upper, steeper section and the lower, flatter step. What’s interesting to me about this section is, as shown in the image below, the scalloped edges form a stunning pattern of bifurcation.

(more…)

Tags: , , , , , ,

Get Hi(RISE) on color!

Thursday, October 18th, 2007

Each HiRISE image has a color strip in the central portion of the image. That strip is comprised of three color wavelengths, blue-green, red and near infrared. Let’s clarify some terms first. RED refers to the visible wavelength portion of the spectrum in which the full-width HiRISE images are taken. These look black and white, not red, because they are displayed in grayscale. But we call them RED images. The other two colors seen by the HiRISE camera are in the visible blue-green (called BG) and invisible near infrared (often called NIR, but we refer to it here as IR).

color_spectrum.jpg

The magic happens when we succeed at coregistering the IR and BG to the RED parts of the image to produce the center strip, false color images. More about this in an upcoming post. The maximum width of a color image is 4048 pixels. Some HiRISE images are 100,000 pixels long, which makes for a very long skinny image. These are affectionately dubbed “color noodles” by the HiPI (PI=Principle Investigator).

The image below illustrates where the color portion of the image is located. The zoomed in part of the same image just shows more clearly how the colors can offer more detailed geologic information than is available in the RED (black and white) image. For detailed information about the use of the color products and how they can be interpreted for scientific purposes, please refer to “Information for Scientific Users of HiRISE Color Products”

psp_002809_1965_colorstrip_small.jpg

psp_002809_1965_crop.jpg

Is this what Mars really looks like? The images are not true color. The three color images taken by HiRISE are coregistered and stacked on top of each other. Then each color layer is assigned to red, blue or green, because those are the colors that are projected on your screen. So you can see how the word “color” becomes quite confusing. First, red is black and white. Then, we have all those I’s R’s and G’s and B’s! The color in HiRISE color products is really false color, because we are assigning a visible color to one that is invisible to human eyes. Also, there are only three wavelengths of light, not the full visible spectrum we are used to seeing. The RGB products are more similar to “natural” color. Even with HiRISE’s limited color capability, there is still an incredible amount of information gained by having the two extra wavelengths.

Why is there a garish green strip along the right side of the color image (left side in the nomap products)? You will notice this in some of the HiRISE color products. It will be apparent in the IRB, but not the RGB products. This is due to one half of the IR10 CCD having electronics issues during the earlier part of the mission. This problem was resolved for most cases, so that later images have both channels of IR10 — no green strip. Some of the earlier images were also able to be reprocessed to restore the missing IR information.

What is the difference between “RGB” and “IRB”? The RGB products are different than the IRB products in that the IR channel has been replaced by a “synthetic blue” layer that creates an image that is somewhat closer to natural color. In many of the images, the infrared band does not contribute a lot of information. The bands in this product have also been stretched to provide better contrast. In other words, the RGB images are more aesthetic. The IRB product is a science product. It contains the IR, RED and BG layers.

In the IAS viewer, you can turn the bands on and off to see what information each one contributes to a particular image. Use this button ias_band_button.jpg to switch from color to grayscale. This dialogue will also allow you to switch the color assigned to each band. The way the images are stacked in the HiRISE images goes like this:

layer_scheme.jpg

Changing two bands to display the same color will show what kind of information is contributed by each band.

Below is a detail from PSP_004052_2045 showing the IRB color overlaid on the RED image. It is a beautiful example of how the color available in HiRISE images gives us new information that aids in interpreting the images. They are also just plain beautiful.

psp_004052_2045_detail.jpg

Tags: , , , , , , , , , , , , , ,

Dr. D.R.A.

Tuesday, October 16th, 2007

With the color images, dynamic range becomes more important then ever before. The DRA (Dynamic Range Adjustment) options of the IAS viewer are a great boon when looking at these images.

DRA performs what image processing folks call a “stretch.” A stretch takes some range of pixel values from the file and maps it onto a new range for the screen. To take an example, consider an image that appears over-exposed: much of the information is in the upper range of pixel values and you will have trouble distinquishing any detail. If the over-exposed pixels are not completely saturated (i.e. they don’t all have the maximum value) then a stretch that reduces brightness can reveal this otherwise hidden detail.

HiRISE has a very high signal-to-noise ratio, and our targeting specialists do a very good job choosing camera settings (which they do individually for each and every image) so completely saturated pixels are very rare.

But this also means that a stretch that works well over the entire image (a global stretch) may not be the best, the optimal stretch, for any one sub-image area that you are viewing. This is where the Auto DRA function in IAS becomes critical.

The button (shown below) is located on the right-hand side of the toolbar. A single click will do a stretch based only on the pixels you are viewing. This can bring out detail in shadow–amazingly, there is enough ambient light scattering around in the thin atmosphere to illuminate those scenes (and HiRISE is sensitive enough to pick enough of it up). It can also bring out detail in bright areas of over-exposure. For the color images in particular this can make things look a whole lot better.

IAS Auto DRA icon

Another factor plays a part in this. By default, the IAS viewer performs a global DRA when the image is loaded. As seen in the screenshot below, there are areas in our image that can skew the stretch. The large red rectangle is an area where the red CCDs start imaging before the blue-green. The IRB images often will have a cyan region where one of the IR CCDs was too noisy. We have elected to keep these areas in our images.

IAS Screenshot 1

When in a sub-area, hit the Auto DRA button and the image should be drastically improved, as you can see in this final screenshot.

IAS Screenshot 2

DRA early and often!

Tags: , , , ,

Introducing the NOMAPs

Wednesday, October 10th, 2007

Starting with the 10/10 release, color images are included for the first time. We’ll describe how we process these in the days and weeks to come. But what I’d like to do first is give a brief description of all our product types as they currently are available. You’ve no doubt noticed a mind-boggling array of new options on our product pages. They now include what we call our “NOMAP” products; NOMAP means that they are not map-projected. In other words, not rotated to the direction of north, not mapped to a coordinate system, and not scaled to any particular geometric resolution.

I’ve prepared this ugly table that outlines each of the products now available (excluding the raw EDRs). So reading the columns from left to right: there are three types of “NOMAP” products, two types of lossy “QLOOK” (Quicklook) RDRs, and two types of lossless RDRs.

HiRISE
Products
“NOMAP” RDR
“QLOOK”  
Grayscale RED RED RED
Color RGB COLOR COLOR
IRB
JP2 Lossy Lossless

With that as a reference, now I’ll try to define everything more precisely.

“NOMAP”
Non map-projected product. Always lossy compressed for smaller size and quicker viewing. These are not formal Planetary Data System products; they’re “special”, meaning there is no PDS label and no Software Interface Specification describing them. Available for IRB, RGB and RED.
RDR
Reduced Data Record: reduced in the sense of refined or processed, not raw data. Formal PDS products with accompanying labels and a detailed SIS document describing their format and processing steps. Available both in lossless and quicklook formats for both RED & COLOR.
“QLOOK”
Quicklook: a special product that is a lossy compressed version of the RDR. In a normal RDR, all of the original data is retained. But with a quicklook, some of the highest resolution detail is discarded to make for quicker viewing.
RED
The image obtained by the red-filtered CCDs. It will be over the full swath width, typically data from all ten red CCDs. Covers the visible wavelength band from 550 to 850 nanometers.
IR
Infrared. Covers the near-IR wavelengths from 800-1000 nanometers.
BG
Blue-Green, visible wavelengths from 400-600 nm.
COLOR
A color RDR. It contains data from the IR, BG and center RED ccds. Typically this will be a skinny strip (”center swath”) inside a skinny strip, or as I like to say, the bacon-strip effect.
IRB
An enhanced color NOMAP. It has the same color bands as the RDR: IR, RED and BG.
RGB
An enhanced color NOMAP. It contains only data from the RED and BG. The blue is derived from the difference between the RED and BG. The color bands are RED, BG and the synthetic blue.
EDR
Experiment Data Record, a formal PDS product that is raw uncompressed data with a label header.

Note: we will be working towards making all of these products available for all prior releases.

Tags: , , , , , , , , , , , ,

Rocket ship cookies!

Tuesday, January 16th, 2007

I baked blue-frosted rocket ship cookies yesterday, and Anjani came in to work this morning wearing a shirt that is the *EXACT* same color blue as my cookie frosting! Another Festivus miracle!

Tags: ,