Television standards conversion


Television standards conversion is the process of changing a television transmission or recording from one television system to another. The most common is from NTSC to PAL or the other way around. This is done so television programs in one nation may be viewed in a nation with a different standard. The video is fed through a video standards converter, which makes a copy in a different video system.
Converting between different numbers of lines and different frame rates in video pictures is a complex technical problem. However, the international exchange of television programming makes standards conversion necessary and in many cases mandatory.

History

The first known case of television systems conversion was in Europe a few years after World War II, mainly with the RTF and the BBC trying to exchange their 441 line and 405 line programming.
The problem got worse with the introduction of PAL, SECAM, and the French 819 line service.
Until the 1980s, standards conversion was so difficult that 24 frame/s 16 mm or 35mm film was the preferred medium of programming interchange.

Overview

Perhaps the most technically challenging conversion to make is the PAL to NTSC.
The two TV standards are for all practical purposes, temporally and spatially incompatible with each other. Aside from the line count being different, converting to a format that requires 60 fields every second from a format that has only 50 fields poses difficulty. Every second, an additional 10 fields must be generated—the converter has to create new frames in real time.

Hidden signals: not always transferred

TV contains many hidden signals. One signal type that is not transferred, except on some very expensive converters, is the closed captioning signal. Teletext signals do not need to be transferred, but the captioning data stream should be if it is technologically possible to do so.
With HDTV broadcasting, this is less of an issue, for the most part meaning only passing the captioning datastream on to the new source material. However, DVB and ATSC have significantly different captioning datastream types.

Role of information theory

Theory behind systems conversion

and the Nyquist–Shannon sampling theorem imply that conversion from one television standard to another will be easier if the conversion
The subsampling in a video system is usually expressed as a three-part ratio. The three terms of the ratio are the number of brightness samples and the numbers of samples of the two color components for each complete sample area.
For quality comparison, only the ratio between those values is important, so 4:4:4 could easily be called 1:1:1; but traditionally the value for brightness is always 4, with the rest of the values scaled accordingly.
The sampling principles above apply to both digital and analog television.

Telecine judder

The "3:2 pulldown" conversion process for 24 frame/s film to television creates a slight error in the video signal compared to the original film frames. This is one reason why motion in 24-fps films viewed on typical NTSC home equipment may not appear as smooth as when viewed in a cinema. The phenomenon is particularly apparent during slow, steady camera movements, which appear slightly jerky when telecined. This process is commonly called telecine judder.
PAL material in which 2:2:2:2:2:2:2:2:2:2:2:3 pulldown has been applied, suffers from a similar lack of smoothness, though this effect is not usually called telecine judder. Every 12th film frame is displayed for the duration of 3 PAL fields, whereas each of the 11 other frames is displayed for the duration of 2 PAL fields. This causes a slight "hiccup" in the video about twice a second.
Television systems converters must avoid creating telecine judder effects during the conversion process. Avoiding this judder is economically importance, because much NTSC resolution material that originates from film will have this problem when converted to PAL or SECAM.

Historical standards conversion techniques

Orthicon to orthicon

This method was used by Ireland to convert 625 line service to 405 line service. It is perhaps the most basic television standard conversion technique. RTÉ used this method during the latter years of its use of the 405 line system.
A standards converter was used to provide the 405 line service, but according to more than one former RTÉ engineering source the converter blew up and afterwards the 405 line service was provided by a 405 line camera pointing at a monitor. This is not the best conversion technique but it can work if one is going from a higher resolution to a lower one – at the same frame rate. Slow phosphors are required on both orthicons.
The first video standards converters were analog. That is, a special professional video camera that used a video camera tube would be pointed at a cathode ray tube video monitor. Both the camera and the monitor could be switched to either NTSC or PAL, to convert both ways. Robert Bosch GmbH's Fernseh division made a large three rack analog video standards converter. These were the high-end converters of the 1960s and 1970s. Image Transform in Universal City, California, used the Fernseh converter and in the 1980s made their own custom digital converter. This was also a larger three-rack device. As digital memory size became larger in smaller packages, converters became the size of a microwave oven. Today one can buy a very small consumer converter for home use.

SSTV to PAL and NTSC

The Apollo moon missions used slow-scan television as opposed to normal bandwidth television; this was mostly done to save battery power. The camera used only 7 watts of power.
SSTV was used to transmit images from inside Apollo 7, Apollo 8, and Apollo 9, as well as the Apollo 11 Lunar Module television from the Moon; see Apollo TV camera.
Later Apollo missions featured color field sequential cameras that output 60-frame/s video. Each frame corresponded to one of the RGB primary colors. This method is compatible with black and white NTSC, but incompatible with color NTSC. In fact, even NTSC monochrome TV compatibility is marginal. A monochrome set could have reproduced the pictures, but the pictures would have flickered terribly. The camera color video ran at only 10 frame/s. Also, Doppler shift in the lunar signal would have caused pictures to tear and flip. For these reasons, the Apollo moon pictures required special conversion techniques.
The conversion steps were completely electromechanical, and they took place in nearly real time. First, the downlink station corrected the pictures for Doppler shift. Next, in an analog disc recorder, the downlink station recorded and replayed every video field six times. On the six-track recorder, recording and playback took place simultaneously. After the recorder, analog video processors added the missing components of the NTSC color signal: These components included:
The conversion delay lasted only some 10 seconds. Then color moon pictures left the downlink station for world distribution.

Standards conversion methods in common use

Nyquist subsampling

This conversion technique may become popular with manufacturers of HDTV --> NTSC and HDTV --> PAL converter boxes for the ongoing global conversion to HDTV.
In a typical image transmission setup, all stationary images are transmitted at full resolution. Moving pictures possess a lower resolution visually, based on complexity of interframe image content.
When one uses Nyquist subsampling as a standards conversion technique, the horizontal and vertical resolution of the material are reduced – this is an excellent method for converting HDTV to standard definition television, but it works very poorly in reverse.
The Nyquist subsampling method of systems conversion only works for HDTV to Standard Definition Television, so as a standards conversion technology it has a very limited use. Phase Correlation is usually preferred for HDTV to standard definition conversion.

Framerate conversion

There is a large difference in frame rate between film and NTSC. Unlike the two other most common video formats, PAL and SECAM, this difference cannot be overcome by a simple speed-up, because the required 25% speed-up would be clearly noticeable.
To convert 24 frame/s film to 29.97 frame/s NTSC, a complex process called "" is used, in which every other film frame is duplicated across an additional interlaced field to achieve a framerate of 23.976. This produces irregularities in the sequence of images which some people can perceive as a stutter during slow and steady pans of the camera in the source material. See telecine for more details.
For viewing native PAL or SECAM material on NTSC equipment, a standards conversion has to take place. There are basically two ways to accomplish this.
When converting PAL to NTSC, the converter must eliminate 100 lines per frame. The converter must also create five frames per second.
To reduce the 625-line signal to 525, less expensive converters drop 100 lines. These converters maintain picture fidelity by evenly spacing removed lines. To create the five additional frames, the converter repeats every fifth frame.
If there is little inter-frame motion, this conversion algorithm is fast, inexpensive and effective. Many inexpensive consumer television system converters have employed this technique. Yet in practise, most video features significant inter-frame motion. To reduce conversion artefacts, more modern or expensive equipment may use sophisticated techniques.

Doubler

The most basic and literal way to double lines is to repeat each scanline, though the results of this are generally very crude. Linear interpolation use digital interpolation to recreate the missing lines in an interlaced signal, and the resulting quality depends on the technique used. Generally the bob version of linear deinterlacer will only interpolate within a single field, rather than merging information from adjacent fields, to preserve the smoothness of motion, resulting in a frame rate equal to the field rate The former technique in moving areas and the latter in static areas, which improves overall sharpness.

Interfield interpolation

Interfield Interpolation is a technique in which new frames are created by blending adjacent frames, rather than repeating a single frame. This is more complex and computationally expensive than linear interpolation, because it requires the interpolator to have knowledge of the preceding and the following frames to produce an intermediate blended frame. Deinterlacing may also be required in order to produce images which can be interpolated smoothly. Interpolation can also be used to reduce the number of scanlines in the image by averaging the colour and intensity of pixels on neighbouring lines, a technique similar to Bilinear filtering, but applied to only one axis.
There are simple 2-line and 4 line converters. The 2-line converter creates a new line by comparing two adjacent lines, whereas a 4-line model compares 4 lines to average the 5th. Interfield interpolation reduces judder, but at the expense of picture smearing. The greater the blending applied to smooth out the judder, the greater the smear caused by blending.

Adaptive motion interpolation

Some more advanced techniques measure the nature and degree of inter-frame motion in the source, and use adaptive algorithms to blend the image based on the results. Some such techniques are known as motion compensation algorithms, and are computationally much more expensive than the simpler techniques, thus requiring more powerful hardware to be effective in real-time conversion.
Adaptive Motion algorithms capitalize on the way the human eye and brain process moving images – in particular, detail is perceived less clearly on moving objects.
Adaptive interpolation requires that the converter analyzes multiple successive fields and to detect the amount and type of motion of different areas of the picture.
Adaptive Motion Interpolation has many variations and is commonly found in midrange converters. The quality and cost is dependent upon the accuracy in analyzing the type and amount of motion, and the selection of the most appropriate algorithm for processing the type of motion.

Adaptive motion interpolation + block matching

Block matching involves dividing the image into mosaic blocks – say perhaps for the sake of explanation, 8x8 pixels. The blocks are then stored in memory. The next field read out is also divided up into the same number and size of mosaic blocks. The converter's computer then goes to work and starts matching up blocks. The blocks that stayed in the same relative position receive relatively little processing.
When panning from left to right is taking place it is safe to assume that the 11th field will be similar or very close.
The technique is highly effective but it does require a tremendous amount of computing power. Consider a block of only 8x8 pixels. For each block, the computer has 64 possible directions and 64 pixels to be matched to the block in the next field. Also consider that the greater the motion, the further out the search must be conducted. Just to find an adjacent block in the next field would entail making a search of 9 blocks. 2 blocks out would require a search and match of 25 blocks – 3 blocks further distant and it grows to 49 etc.
The type of motion can exponentially compound the compute power required. Consider a rotating object, where a simple straight line motion vector is of little help in predicting where the next block should match. It can quickly be seen that the more inter frame motion introduced, the much greater the processing power required. This is the general concept of block matching. Block match converters can vary widely in price and performance depending on the attention to detail and complexity.
A weird artifact of block matching owes to the size of the block itself. If a moving object is smaller than the mosaic block, consider that it's the entire block that gets moved. In most cases, it's not an issue, but consider a thrown baseball. The ball itself has a high motion vector, but its background that makes up the rest of the block might not have any motion. The background gets transported in the moved block as well, based on the motion vector of the baseball, What you might see is the ball with a small amount of outfield or whatever, tagging along. As it's in motion, the block may be "soft" depending upon what additional techniques were used and barely noticeable unless you're looking for it.
Block matching requires a staggering amount of processing horsepower, but today's microprocessors are making it a viable solution.

Phase correlation

Phase correlation is perhaps the most computationally complex of the general algorithms.
Phase correlation's success lies in the fact that it is effective with coping with rapid motion and random motion. Phase correlation does not easily get confused by rotating or twirling objects that confuse most other kinds of systems converters. Phase correlation is elegant as well as technically and conceptually complex. Its successful operation is derived by performing a Fourier transform to each field of video.
A Fast Fourier Transform is an algorithm which deals with the transformation of discrete values. When applied to a sample of finite values, a Fast Fourier Transform expresses any changes in terms of frequency components.
Since the result of the FFT represents only the inter-frame changes in terms of frequency distribution, there is far less data that has to be processed in order to calculate the motion vectors.

DTV to analog converters for consumers

A digital television adapter,, or digital-to-analog converter, is a device that receives, by means of an antenna, a digital television transmission, and converts that signal into an analog television signal that can be received and displayed on an analog television.
These boxes cheaply convert HDTV to. Very little is known about the specific conversion technologies used by these converter boxes in the PAL and NTSC zones.
Downconversion is usually required, hence very little image quality loss is perceived by viewers at the recommended viewing distance with most TV sets.

Offline conversion

A lot of cross format television conversion is done offline. There are several DVD packages that offer offline PAL ↔ NTSC conversion – including cross conversion from the myriad of MPEG-based web video formats.
Cross conversion can use any method commonly in use for TV system format conversion, but typically it is left up to the codec to do the conversion. Most modern DVDs are converted from 525 <--> 625 lines in this way, as it is very economical for most programming that originates at EDTV resolution.