CN103548354A - Coding and decoding with adaptive contextual model selection via sawtooth scanning - Google Patents

Abstract

There is a kind of coding. The encoding may include preparing, with a processor, video compression data based on a source picture. The preparing may include processing the generated transform unit, including generating a significance map having an array of significance maps having y-x positions corresponding to the y-x positions of the transform array. The generating may include scanning a plurality of significance map elements in a significance map array with a zig-zag scanning pattern. The generating may further include determining a context model using a zig-zag scan pattern for coding one of the plurality of significance map elements based on values associated with at least one coded neighbor significance map element of the significance map elements in the significance map array. There is also a decoding including processing of video compression data generated in the coding.

Description

Utilize encode and the decoding by the self adaptation context model of sawtooth scan, selected

Priority

The present invention requires the sequence number 61/389 of " Adaptive Context Selection for Zigzag Scan " by name that Jian Lou etc. submits on October 5th, 2010, the rights and interests of the priority of 932 U.S. Provisional Patent Application, are disclosed all and are herein incorporated by reference.

The cross reference of related application

The sequence number 13/253 that is called " Coding and Decoding Utilizing Context Model Selection with Adaptive Scan Pattern " that the application and Jian Lou etc. submitted on October 5th, 2011,933 U.S. Patent application is relevant, the sequence number 61/393 that is called " Context Selection for Adaptive Scanning Pattern " that above-mentioned application requirement Jian Lou etc. submitted on October 14th, 2010, the priority of 198 U.S. Provisional Patent Application, is disclosed all and is herein incorporated by reference.

Background technology

Video compression utilizes piece to process for multiple operation.In piece is processed, the piece of neighbor is grouped into encode unit, and squeeze operation is considered as a unit by this pixel groups, to utilize the correlation between neighbor in encode unit.Block-based processing often comprises prediction code and transform code.It with the transform code quantizing, is the data compression of a type, the data that such data compression is associated with transform block the picture of source because the quantification of the transform block of obtaining from source picture often abandons and " diminishing " conventionally, thereby reduced its bandwidth requirement, but conventionally also caused from the reproduction quality of the original transform piece of source picture lower.

H.264 MPEG-4AVC, be also referred to as, and is the video compression standard of having set up that utilizes the transform code in piece processing.In H.264, picture is divided into the macro block (MB) of 16 * 16 pixels.Each MB is often further divided into less piece.With in picture/inter-picture prediction comes prediction scale to be equal to or less than the piece of MB, and spatial alternation is applied to prediction residual together with quantizing.Conventionally use entropy encode method (that is, variable-length codes or arithmetic code) to encode to the quantization transform coefficient of residual error.H.264 in, introduce context adaptive binary arithmetic code (CABAC), with by by adaptive binary arithmetic code technology and a group context model group is incompatible that substantially harmless compression efficiency is provided.Context model is chosen in CABAC is providing self adaptation to a certain degree to work with reducing in redundancy.H.264 specify two kinds of scanning patterns on 2D piece.Sawtooth scan is for utilizing the picture of progressive scanned video compress technique encode, and mixed sweep is for utilizing the picture of interlaced scanning video compress technique encode.

H.264 use the block-based conversion of 2D of block size 2 * 2,4 * 4 and 8 * 8.Block-based conversion converts the block of pixels of spatial domain to coefficient block in transform domain.Then quantize conversion coefficient to be mapped to finite aggregate.After quantizing, many high frequency coefficients become 0.For thering is the piece of at least one nonzero coefficient after the operation of 2D transform and quantization, carry out validity mapping, the position of non-zero quantized coefficients in 2D transform domain is specified in this validity mapping.Particularly, in the situation that the 2D transform block of given quantification if the value of the quantization parameter of position (y, x) is non-zero, is thought so effectively, and " 1 " is assigned to the position (y, x) that associated validity is shone upon.Otherwise, " 0 " is assigned to the position (y, x) in validity mapping.In H.264, CABAC is for carrying out encode and decoding to each element of validity mapping.

HEVC (encode of high efficiency video), the international video code standard of exploitation after H.264, transform block scale expands to 32 * 32 pixels from 16 * 16, to be of value to high definition (HD) video code.Considering under the model of HEVC, can be so that the set of conversion coefficient encode and decoding instrument can be used in entropy encode and decoding.Among these instruments, be that adaptive scanning scheme is applied to validity mapping encode and decoding.If validity map array scale is greater than 8 * 8, this scheme is being switched for validity being shone upon between two kinds of scanning patterns that carry out encode and decoding adaptively.

Adaptive scanning scheme is switched two predefined scanning patterns by each diagonal (diagonal from the lower left corner to the Huo Cong upper right corner, the upper right corner to the lower left corner) and is indicated the scanning sequency that validity mapping is carried out to encode and decoding.Switch in each the end of silver coin scanning is occurred, and by two counter controls.The first counter c1 follows the tracks of the number of the encode validity conversion coefficient of the lower-left half that is positioned at transform block.The second counter c2 follows the tracks of the number of the encode validity conversion coefficient of the upper right half that is positioned at transform block.In the situation that using two kinds of scanning patterns and two counters, consider that the model realization of HEVC has brought a large amount of computational complexities and extra memory requirement.These complexity comprise the counting of the encode validity conversion coefficient of following the tracks of the Ban Huo upper right, lower-left half that is positioned at conversion, carry out branch operation and the coefficient in validity mapping encode and decoding is scanned to selection.On the other hand, adaptive scanning scheme has only realized inappreciable performance gain.Or, reducing aspect the bandwidth requirement of the packed data being associated with conversion process, not provide essence gain.

Summary of the invention

According to principle of the present invention, exist the encode of the self adaptation context model selection utilizing under sawtooth scan and system, method and the computer-readable medium (CRM) of decoding are provided.By utilizing the self adaptation context model under sawtooth scan to select, reduced the poor efficiency in conversion process.These comprise the poor efficiency of the expense based on being associated with computation complexity, the counting that comprises the encode validity conversion coefficient of following the tracks of the Ban Huo upper right, lower-left half be positioned at conversion, the scanning of carrying out branch operation and carry out coefficient in validity mapping encode and decoding is selected.

According to First Principle of the present invention, there is a kind of system for encode.Described system can comprise processor, and this processor is configured to prepare video compression data based on source picture.Described preparation can comprise and divides source picture into encode unit.Described preparation can also comprise that generation has one or more converter units of transform array.Described transform array can comprise the conversion coefficient that is assigned to the y-x position of transform array as entry.Conversion coefficient can the residual error based on being associated with encode unit be measured.Described preparation can comprise the converter unit that processing generates.Described processing can comprise that generation has the validity mapping of validity map array, and wherein validity map array has the y-x position corresponding with the y-x position of transform array.Described processing can also comprise a plurality of validity map element of utilizing in sawtooth scan pattern scanning validity map array.Described processing can also comprise and utilize sawtooth scan pattern to determine context model, and the value being associated for neighbours' validity map element of at least one encode of the validity map element based on validity map array is carried out encode to a validity map element in a plurality of validity map element.

According to the second principle of the present invention, there is a kind of method for encode.Described method can comprise based on source picture prepares video compression data.Described preparation can comprise and divides source picture into encode unit.Described preparation can also comprise that generation has one or more converter units of transform array.Described transform array can comprise the conversion coefficient that is assigned to the y-x position of transform array as entry.Conversion coefficient can the residual error based on being associated with encode unit be measured.Described preparation can comprise the converter unit that processing generates.Described processing can comprise that generation has the validity mapping of validity map array, and validity map array has the y-x position corresponding with the y-x position of transform array.Described processing can also comprise a plurality of validity map element of utilizing in sawtooth scan pattern scanning validity map array.Described processing can also comprise and utilize sawtooth scan pattern to determine context model, and the value being associated for neighbours' validity map element of at least one encode of the validity map element based on validity map array is encoded to a validity map element in a plurality of validity map element.

According to the 3rd principle of the present invention, there is a kind of non-provisional CRM that stores computer-readable instruction, when computer system is carried out described computer-readable instruction, carry out a kind of method for encode.Described method can comprise based on source picture prepares video compression data.Described preparation can comprise and divides source picture into encode unit.Described preparation can also comprise that generation has one or more converter units of transform array.Described transform array can comprise the conversion coefficient that is assigned to the y-x position of transform array as entry.Conversion coefficient can the residual error based on being associated with encode unit be measured.Described preparation can comprise the converter unit that processing generates.Described processing can comprise that generation has the validity mapping of validity map array, and validity map array has the y-x position corresponding with the y-x position of transform array.Described processing can also comprise a plurality of validity map element of utilizing in sawtooth scan pattern scanning validity map array.Described processing can also comprise and utilize sawtooth scan pattern to determine context model, and the value being associated for neighbours' validity map element of at least one encode of the validity map element based on validity map array is carried out encode to a validity map element in a plurality of validity map element.

According to the 4th principle of the present invention, there is a kind of system for decoding.Described system can comprise interface, and this interface is configured to receiver, video packed data.Described system can also comprise processor, and this processor is configured to process the video compression data receiving.The video compression data receiving can be based on processing converter unit, based on source picture.Described preparation can comprise and divides source picture into encode unit.Described preparation can also comprise that generation has one or more converter units of transform array.Described transform array can comprise the conversion coefficient that is assigned to the y-x position of transform array as entry.Conversion coefficient can the residual error based on being associated with encode unit be measured.Described preparation can comprise the converter unit that processing generates.Described processing can comprise that generation has the validity mapping of validity map array, and validity map array has the y-x position corresponding with the y-x position of transform array.Described processing can also comprise a plurality of validity map element of utilizing in sawtooth scan pattern scanning validity map array.Described processing can also comprise and utilize sawtooth scan pattern to determine context model, and the value being associated for neighbours' validity map element of at least one encode of the validity map element based on validity map array is carried out encode to a validity map element in a plurality of validity map element.

According to Wuyuan of the present invention reason, there is a kind of method for decoding.Described method can comprise receiver, video packed data.Described method can also comprise processes the video compression data receiving.The video compression data receiving can be based on processing converter unit, based on source picture.Described preparation can comprise and divides source picture into encode unit.Described preparation can also comprise that generation has one or more converter units of transform array.Described transform array can comprise the conversion coefficient that is assigned to the y-x position of transform array as entry.Conversion coefficient can the residual error based on being associated with encode unit be measured.Described preparation can comprise the converter unit that processing generates.Described processing can comprise that generation has the validity mapping of validity map array, and validity map array has the y-x position corresponding with the y-x position of transform array.Described processing can also comprise a plurality of validity map element of utilizing in sawtooth scan pattern scanning validity map array.Described processing can also comprise and utilize sawtooth scan pattern to determine context model, and the value being associated for neighbours' validity map element of at least one encode of the validity map element based on validity map array is carried out encode to a validity map element in a plurality of validity map element.

According to the 6th principle of the present invention, there is a kind of CRM that stores computer-readable instruction, when computer system is carried out described computer-readable instruction, carry out a kind of method for decoding.Described method can comprise processes the video compression data receiving.The video compression data receiving can be based on processing converter unit, based on source picture.Described preparation can comprise and divides source picture into encode unit.Described preparation can also comprise that generation has one or more converter units of transform array.Described transform array can comprise the conversion coefficient that is assigned to the y-x position of transform array as entry.Conversion coefficient can the residual error based on being associated with encode unit be measured.Described preparation can comprise the converter unit that processing generates.Described processing can comprise that generation has the validity mapping of validity map array, and validity map array has the y-x position corresponding with the y-x position of transform array.Described processing can also comprise a plurality of validity map element of utilizing in sawtooth scan pattern scanning validity map array.Described processing can also comprise and utilize sawtooth scan pattern to determine context model, and the value being associated for neighbours' validity map element of at least one encode of the validity map element based on validity map array is carried out encode to a validity map element in a plurality of validity map element.

Principle of the present invention during according to the system of the encode providing the self adaptation context model utilized under sawtooth scan to select and decoding, method and CRM has realized these and other objects.Detailed description of preferred embodiment with reference to the accompanying drawings and below, other feature, its character and various advantage will be more obvious.

Accompanying drawing explanation

According to description with reference to the accompanying drawings, example and disclosed feature are significantly for those skilled in the art, in the accompanying drawings:

What Fig. 1 was diagram according to example utilizes encode system that self adaptation context model selects and the block diagram of decode system by sawtooth scan;

Fig. 2 A is that diagram is according to the scanning pattern of the sawtooth scan for validity mapping encode and decoding of example;

Fig. 2 B is that diagram is according to the scanning pattern of the self adaptation division sawtooth scan for validity mapping encode and decoding of the comparison object of comparative example;

Fig. 3 is that diagram is according to the model of selecting by the self adaptation context model of sawtooth scan in validity mapping encode and decoding of example;

Fig. 4 A is that diagram is according to the model that fixed model is selected in validity mapping encode and decoding of example;

Fig. 4 B is that diagram is according to the model of fixed model selection in the mapping encode of the validity at 4 * 4 arrays of example and decoding;

Fig. 4 C is that diagram is according to the model of fixed model selection in the mapping encode of the validity at 8 * 8 arrays of example and decoding;

Fig. 5 is that diagram is according to the flow chart of the method for the validity mapping that utilizes self adaptation context model selection preparation encode under sawtooth scan of example;

Fig. 6 be diagram according to example for utilize the flow chart of the method for the encode that self adaptation context model selects under sawtooth scan;

Fig. 7 be diagram according to example for utilize the flow chart of the method for the decoding that self adaptation context model selects under sawtooth scan; And

Fig. 8 is that diagram is utilized the system of encode of self adaptation context model selection and/or the block diagram that the system of decoding provides the computer system of platform according to being used to of example under sawtooth scan.

Embodiment

For simplicity and illustrative purposes, by main, with reference to embodiments of the invention, principle and example, the present invention is described.In the following description, a plurality of specific detail have been set forth to complete understanding of the present invention is provided.Yet, be easily apparent that, can be in the situation that do not have the restriction of these characteristic details to put into practice embodiment.In other examples, do not describe certain methods and structure in detail, to avoid unnecessarily obscuring this description.In addition, different embodiment are described below.Embodiment can be used together or carry out according to various combination.

As used herein, term " comprises " that the meaning is " at least comprising ", but be not limited to term, " only comprises ".The term "based" meaning is " at least partly based on ".Term " picture " meaning is the picture that is equal to frame or is equal to the field being associated with frame, such as the field of one group or the two groups interlacing scan row as interlaced video frames.Term " bit stream " is digit data stream.Term " encode " can refer to the coding of uncompressed video sequence.Term " encode " also can refer to the transcoding of compressed video bitstream from a compressed format to another compressed format.Term " decoding " can refer to the decoding of compressed video bitstream.

Following example and embodiment demonstrate, and are stored in computer-readable medium (for example,, CRM) above for utilize the encode of self adaptation context model selection and system, method and the machine readable instructions of decoding under sawtooth scan.With reference to Fig. 1, a kind of content delivering system 100 is disclosed, be included in the encode system 110 and the decode system 140 that under sawtooth scan, utilize self adaptation context model to select.

In encode system 110, self adaptation context model under sawtooth scan select by source picture is divided into encode unit and based on encode cell processing converter unit and with based on source picture, prepare video compression data and be associated.

In decode system 140, self adaptation context model under sawtooth scan is selected to be associated by the video compression information that divides source picture into encode unit and receive with decoding based on encode cell processing converter unit, and this video compression information utilizes self adaptation context model select and prepare when preparing video compression data based on source picture under sawtooth scan.

The encode of converter unit can comprise three aspects: (1) validity mapping encode, the horizontal encode of (2) nonzero coefficient, and (3) nonzero coefficient symbol code.According to example, residual error based on being associated with encode unit is measured, and by generation, is had and is comprised the converter unit of transform array of conversion coefficient that is assigned to the y-x position of transform array as entry, processes converter unit when generating video packed data.The processing of the converter unit generating can comprise that generation has the validity mapping of validity map array, and described validity map array has the y-x position corresponding with the y-x position of transform array.Generate the conversion coefficient in the converter unit that validity mapping can comprise that inspection generates.The encode of validity mapping can comprise and utilizes sawtooth scan pattern to scan a plurality of validity map element in validity map array.Described generation can also comprise the context model that is identified for validity map element to carry out encode.Be discussed in more detail below after self adaptation context model under sawtooth scan selects, in further detail coded description system 110 and decode system 140.

Fig. 2 A is for converter unit (that is the converter unit, with the transform array of self adaptation context model selection) being carried out to the example of the sawtooth scan 200 of validity mapping encode and decoding.For example, Fig. 2 A illustrates the sawtooth scan of 16 * 16.Self adaptation context model selects to utilize sawtooth scan, to determine the sequence of processing such as transformation series transformation of variable element.According to example, utilize sawtooth scan pattern 200 can complete determining of context model.One or more values that neighbours' validity map element of at least one encode of validity map element that can be based on validity map array is associated, select context model.By relatively, in considering the model of HEVC, use self adaptation to cut apart sawtooth scan.Fig. 2 B is the comparative example that self adaptation is cut apart sawtooth scan 250, and will in comparative example below, discuss in further detail.

According to example, during the self adaptation context under sawtooth scan is selected, sawtooth scan 200 is for validity mapping encode and the decoding of all array scales.The neighbours' of the encode based on element value (0 or 1) is determined the context model of element in validity mapping.An example of determining as self adaptation context model, the in the situation that of given validity mapping, can determine the context model of element in validity mapping, as shown in Figure 3, show, for determining the self adaptation context model criterion 300 of the context model of encode and decoding, to comprise processing converter unit.Described processing can comprise generate have with the array of converter unit (such as, be greater than the validity map array of 8 * 8 entries) the validity mapping of corresponding array.The residual error that encode unit based on based on source picture is associated is measured, and validity map array can comprise the validity map element that is assigned to the y-x position of validity map array as entry.For the validity map element of position (0,0), (0,1) or (1,0), in array as shown in Figure 3, can assign unique context model.

For position (0, x>1) validity map element, in array as shown in Figure 3, can position-based (0, x-1), (0, x-2), (1, x-2) and at x, to be that even number situation is the next be set to (1, the neighbours' of element x-1) value (0 or 1), selects context model.

For position (y>1,0) validity map element, in array as shown in Figure 3, can position-based (y>1,0), (y-2,0), (y-2,1) and be the next (y-1 that is set to of odd number situation at y, 1) neighbours' of element value (0 or 1), selects context model.

For position (y>0, x>0) validity map element, in array as shown in Figure 3, can position-based (y-1, x-1), the neighbours' of (y-1, x), (y, x-1) and following position element value (0 or 1) is selected context model: at x, be greater than the position (y-1 in 1 situation, x-2) and (y, x-2); X be greater than 1 and y be less than the position (y+1, x-2) of height in-1 situation; At y, be greater than position (y-2, x-1) and (y-2, the x) in 1 situation; Y be greater than 1 and x be less than the position (y-2, x+1) in the situation of width-1; At x and y sum, be that odd number and x are less than the position (y-1, x+1) in the situation of width-1; And be that even number and y are less than the position (y+1, x-1) in height-1 situation at x and y sum.

For the validity mapping based on having the converter unit of the transform array that is less than or equal to 8 * 8 entries, fixedly criterion model is applied in the position in the array that can shine upon based on validity.Fig. 4 A to Fig. 4 C illustrates the context model of 2 * 2,4 * 4 and 8 * 8 validity map array.They design based on following hypothesis: for the array of identical scale, the value (0 or 1) of the ad-hoc location shining upon in validity can be followed similar statistical model.The context selection scheme of describing in Fig. 4 A, Fig. 4 B and Fig. 4 C utilizes array position as context selection criterion.Yet for larger array scale, the array position of increase may increase the number that possible context is selected greatly, indication needs more multi-memory like this.Can utilize application to select by the self adaptation context model of sawtooth scan, with the number that the context that is greater than 8 * 8 array is selected, remain on actual limit.

Example as a comparison, in TMuC0.7, consider HEVC a model realization set of conversion coefficient encode and decoding instrument.When entropy encode option is CABAC/PIPE, under default situations, open.Among these instruments, as shown in Figure 2 B, self adaptation is cut apart sawtooth scan 250 and is applied to validity mapping encode and decoding.Experimental result is indicated this self adaptation to cut apart sawtooth scan 250 schemes and has only been realized inappreciable performance gain.But, as the sawtooth scan as shown in Fig. 2 A, compare, also introduced annex memory and computation complexity.

In TMuC0.7, under default situations, entropy encode is set to use option CABAC/PIPE, and it has merged the set of conversion coefficient encode and decoding instrument.The set of the encode in other HEVC models and decoding instrument comprises adaptive scanning scheme, if conversion scale is greater than 8 * 8, this adaptive scanning scheme is switched adaptively between validity mapping encode and two kinds of sweeping schemes of decoding so.In TMuC0.7, the scanning sequency that is allowed for encode and the mapping of decoding validity is switched two kinds of predefined scanning patterns at each diagonal (that is, the diagonal from the lower left corner to the Huo Cong upper right corner, the upper right corner to the lower left corner).At each, the end of silver coin scanning is switched, and by two counter controls, c1 controls the number of the encode validity conversion coefficient of the lower-left half that is positioned at transform block, and c2 controls the number of the encode validity conversion coefficient of the upper right half that is positioned at transform block.

Fig. 2 B illustrates the comparative example of the adaptive scanning of 16 * 16, and wherein, diagonal scan can be any one of two kinds of modes.In the situation that current, realize validity mapping encode and the decoding of TMuC0.7, with a sawtooth scan pattern and two counter c ₁and c ₂compare, this adaptive scanning need to be for the annex memory of two scanning patterns.Owing to counting for the number that is positioned at the encode validity conversion coefficient of Ban Huo upper right, lower-left half, before branch operation and last validity coefficient, the scanning of each coefficient is selected, and has also introduced additional computational complexity.Adjacent element based on encode in validity mapping carrys out the context model of element in effectiveness of selection mapping.Because diagonal scan can be any of two kinds of modes, be therefore necessary to check whether upper right element or lower-left element can be used for the given currentElement in validity mapping encode and decoding.This causes added branch operation.Experimental result indicates this adaptive scanning scheme only to realize inappreciable performance gain, but needs annex memory and increased computation complexity.

In example in accordance with the principles of the present invention, when selecting CABAC/PIPE, as the sawtooth scan 200 of sawtooth scan for validity mapping encode and decoding.For larger converter unit (that is, thering is the converter unit that is greater than 8 * 8 arrays), can revise TMuC0.7 to replace the adaptive scanning under sawtooth scan 200.For example, Fig. 2 illustrates the sawtooth scan of 16 * 16 arrays.Owing to having fixed scanning pattern, the neighbouring relations that context is selected have therefore also been fixed.No longer there is annex memory demand and the computation complexity being associated with the adaptive scanning of TMuC0.7 kind, and can utilize self adaptation context to select, self adaptation context criteria 300 as shown in Figure 3 all and as above.

Because the poor efficiency in conversion process is reduced, therefore utilize the self adaptation context model under sawtooth scan to select to have improved encode efficiency.These comprise the poor efficiency of the expense based on being associated with computation complexity, the counting that comprises the encode validity conversion coefficient of following the tracks of the Ban Huo upper right, lower-left half be positioned at conversion, the scanning of carrying out branch operation and carry out coefficient in validity mapping encode and decoding is selected.

Refer again to Fig. 1, encode system 110 comprises input interface 130, controller 111, counter 112, frame memory 113, coding unit 114, transmitter buffer 115 and output interface 135.Decode system 140 comprises receiver buffer 150, decoding unit 151, frame memory 152 and controller 153.Encode system 110 and decode system 140 are coupled to each other via the transmission path that comprises compression bit stream 105.The capacity of the controller 111 of encode system 110 based on receiver buffer 150 controlled the data volume that will launch, and can comprise other parameters, such as the data volume of time per unit.Controller 111 control coding unit 114, to prevent that the reception signal decoding operation of decode system 140 from occurring unsuccessfully.Controller 111 can be processor, or comprises the microcomputer for example with processor, random access memory and read-only memory.

For example, the source picture 120 providing from content provider can comprise sequence of frames of video, comprises the source picture of video sequence.Source picture 120 can be not compress or compress.If source picture 120 is not compress, encode system 100 can be associated with encoding function.If source picture 120 compresses, encode system 110 can be associated with transcoding function.Can utilize controller 111 to obtain encode unit from source picture.Frame memory 113 can have ，Gai first area, first area and can be for storage from source picture 120, import source picture into; And second area, this second area can be for reading source picture and they being outputed to coding unit 114.Controller 111 can be to frame memory 113 output area switch-over control signals 123.Region switch-over control signal 123 can be indicated and be utilized first area or second area.

Controller 111 is to coding unit 114 output encoder control signals 124.Coding control signal 124 makes coding unit 114 start encoding operation, such as preparing encode unit based on source picture.In response to the coding control signal 124 that carrys out self-controller 111, coding unit 114 starts to read the encode unit of preparation, to carry out high efficient coding processing, such as prediction code processing or transform codeization, process, its encode unit of processing preparation is with the source picture generating video packed data based on being associated with encode unit.

Coding unit 114 can be packaged into the video compression data of generation the Packet Elementary Stream (PES) that comprises video packets.Coding unit 114 can be used control information and Pgmtime stamp (PTS) that video packets is mapped to encoded video signal 122, and encoded video signal 122 can be signalled to transmitter buffer 115.

The encoded video signal 122 that comprises generated video compression data can be stored in transmitter buffer 115.Traffic count device 112 increases progressively, to indicate the data total amount in transmitter buffer 115.Along with retrieving from buffer and removing data, counter 112 can successively decrease, to reflect the data volume in transmitter buffer 115.Occupied zone domain information signal 126 can be launched into counter 112, is added transmitter buffer 115 to or removed from transmitter buffer 115, thereby can makes counter 112 increasing or decreasings to indicate the data from coding unit 114.Controller 111 can be controlled the product of the video packets being produced by coding unit 114 by the occupied zone domain information 126 based on can communications, to prevent from occurring in transmitter buffer 115 overflow or underflow.

Traffic count device 112 can be reset in response to the preset signals 128 that is generated and exported by controller 111.After traffic count device 112 is reset, can counts the data of being exported by coding unit 114, and obtain the video compression data generated and/or the amount of video packets.Then, traffic count device 112 can provide to controller 111 the amount of information signal 129 of the amount of information that represents acquisition.Controller 111 can control coding unit 114, and making does not have overflow at transmitter buffer 115 places.

Decode system 140 comprises input interface 170, receiver buffer 150, controller 153, frame memory 152, decoding unit 151 and output interface 175.The receiver buffer 150 of decode system 140 is store compressed bit stream 105 temporarily, and compression bit stream 105 comprises receiver, video packed data and the video packets based on source picture from source picture 120.Decode system 140 can read control information and the presentative time stamp information being associated with the video packets receiving in data, and output frame number signal 163, and frame number signal 163 is applied to controller 153.Controller 153 can be supervised a frame number for counting to be scheduled to an interval, for example, and when each decoding unit 151 completes decode operation.

When frame number signal 163 is indicated receiver buffers 150 in predetermined volumes, controller 153 can be to decoding unit 151 output decoding commencing signals 164.When frame number signal 163 indication receiver buffers 150 are less than predetermined volumes, controller 153 can wait for that the frame number of the counting situation that equals scheduled volume that becomes occurs.When frame number signal 163 is indicated receiver buffers 150 in predetermined volumes, controller 153 can be exported decoding commencing signal 164.The presentative time stamp that the video packets of coding and video compression data can the video packets based on coding be associated is decoded with single order (that is, increase or reduce).

In response to decoding commencing signal 164, the compressed video data that decoding unit 151 can be associated to the picture that amounts to the data of a picture being associated with frame and be associated with video packets from receiver buffer 150 is decoded.Decoding unit 151 can write the vision signal of decoding 162 in frame memory 152.Frame memory 152 can have first area that decoded video signal is written into and for decoding picture 160 being read into the second area of output interface 175.

According to different examples, encode system 110 can merge or otherwise be associated with transcoder or encoding device at head end, and decode system 140 can merge or be associated with upstream device (such as mobile device, Set Top Box or transcoder).When processing converter unit, in encode and/or coding/decoding method that the self adaptation context model under utilizing sawtooth scan is selected, utilize these separately or together.Below with reference to Fig. 5, Fig. 6 of describing method 500,600 and 700 and Fig. 7, describing in further detail can code system 110 and the variety of way of decode system 140.

Method 500 is a kind of methods of preparing the validity mapping of encode for utilizing self adaptation context model under sawtooth scan to select.Method 600 is a kind of methods for utilizing the validity mapping of encode unit and encode to carry out encode, and wherein, the mapping of the validity of encode is to utilize the self adaptation context model of using under sawtooth scan to select the converter unit of processing to prepare.Method 700 is a kind of methods of decoding for the packed data utilizing by utilizing the validity mapping of encode unit and encode to generate, wherein, the mapping of the validity of encode is to utilize the self adaptation context model of using under sawtooth scan to select the converter unit of processing to prepare.It will be apparent to those of ordinary skill in the art that method 500,600 and 700 represents broad sense explanation and can add other steps, and can remove, revise or rearrange existing step in the situation that do not depart from the scope of method 500,600 and 700.Encode system 110 and the decode system 140 specific descriptions methods 500,600 and 700 with reference to Fig. 1, described.Yet, should be appreciated that in the situation that do not depart from the scope of method 500,600 and 700 can be in the system different with decode system 140 from encode system 110 and/or equipment implementation method 500,600 and 700.

With reference to the method 500 in Fig. 5, in step 501, the controller 111 being associated with encode system 110 is such as dividing source picture into encode unit by quaternary tree form.

In step 502, the residual error based on being associated with encode unit is measured, and controller 111 generates converter unit, comprises at least one converter unit with transform array, and transform array comprises the conversion element that is assigned to the y-x position of transform array as entry.Can after prediction processing, generate converter unit, this prediction processing is also used when generating video packed data.

In step 503, the validity that controller 111 has validity map array by generation shines upon to process generated converter unit, and this validity map array has the y-x position corresponding with y-x position in transform array.Step 503 can be become step 503A-503B by Further Division, as follows.

At step 503A, controller 111 and coding unit 114 utilize sawtooth scan pattern to scan a plurality of validity map element in validity map array.

At step 503B, the value of controller 111 based on being associated with at least one neighbours' validity map element of validity map element in validity mapping is identified for a context model that validity map element is carried out encode in a plurality of validity map element.

At step 503C, controller 111 and coding unit 114 utilize definite context model to carry out encode to validity map element, to form the validity map element of the validity mapping of encode.It can be that entropy encode is processed that this encode is processed, so that the y-x array of validity mapping is reduced to better simply matrix.

With reference to the method 600 in Fig. 6, in step 601, the interface 130 of encode system 110 and frame memory 113 receive the source picture 120 that comprises source picture.

In step 602, controller 111 is prepared encode unit and converter unit, comprises the converter unit based on source picture.Can be above with reference to carrying out this preparation described in Fig. 5.

In step 603, controller 111 and coding unit 114 are processed the converter unit of preparing, and the converter unit of this preparation generates video compression data based on encode unit.

In step 604,114 pairs of video compression datas that generate of controller 111 and coding unit are packed.

In step 605, controller 111 and transmitter buffer 115 are launched the video compression data of packing in compression bit stream 105 via interface 135.

With reference to the method 700 in Fig. 7, in step 701, decode system 140 receives via interface 170 and receiver buffer 150 compression bit stream 105 that comprises video compression data.

In step 702, decode system 140 receives via interface 170 and receiver buffer 150 the residual error picture being associated with video compression data.

In step 703, decoding unit 151 and controller 153 are processed the video compression data receiving.

In step 704, the picture that video compression data based on after processing of decoding unit 151 and controller 153 and the residual error picture receiving become reconstruct next life.

In step 705,153 pairs of reconstructed pictures that generate of decoding unit 151 and controller are packed, and then their signals are transferred to frame memory 152.

In step 706, controller 153 transmits the picture of the reconstruct being generated with the signal 180 use signals of decoding via interface 175.

Some or all of said method and operation can be used as the machine readable instructions (such as instrument, computer program etc.) being stored on computer-readable recording medium and provide, computer-readable recording medium is can right and wrong provisional, such as hardware storage device or other types memory device.For example, they can be used as and comprise with the program of the program command of source code, object code, executable code or extended formatting and exist.

The example of computer-readable recording medium comprises conventional computer system RAM, ROM, EPROM, EEPROM and disk or CD or band.Aforementioned concrete example comprises the program distribution on CD ROM.Therefore, should be appreciated that any electronic equipment that can carry out above-mentioned functions can carry out above-mentioned those functions of enumerating.

With reference to Fig. 8, platform 800 is shown, in encode or decode system that the self adaptation context model under utilizing sawtooth scan is selected, such as encode system 100 and/or decode system 200, platform 800 can be used as computing equipment.Platform 800 also can be for upstream code device, transcoder or upstream device (such as Set Top Box, mobile phone, mobile phone or other mobile devices), can utilize self adaptation context model under sawtooth scan to select and use self adaptation context model under sawtooth scan to select the converter unit processed and transcoder and other equipment and the device of association code unit.The diagram that is appreciated that platform 800 is the diagram of broad sense, and platform 800 can comprise add-on assemble, and can remove and/or revise some assemblies in the assembly of description in the situation that do not depart from the scope of platform 800.

Platform 800 comprises processor 801, such as CPU; Display 802, such as monitor; Interface 803, moves the network interface of WAN or WiMax WAN such as simple input interface and/or with local area network (LAN) (LAN), wireless 802.11x LAN, 3G or 4G; With computer-readable medium 804.Each in these assemblies is operably coupled to bus 808.For example, bus 808 can be EISA, PCI, USB, live wire (FireWire), NuBus or PDS.

Computer-readable medium (CRM) can be to participate in instruction to offer any suitable medium of processor 801 for carrying out such as CRM804.For example, CRM804 can be non-volatile media, such as light or disk; Volatile media, such as memory; And transmission medium, such as coaxial cable, copper cash and optical fiber.Transmission medium also can be taked the form of sound, light or rf wave.CRM804 also can store other instructions or instruction set, comprises word processor, browser, Email, instant message transrecieving, media player and telephone code.

CRM804 also can storage operation system 805, such as MAC OS, MSWINDOWS, UNIX or LINUX; Application 806, network application, word processor, spreadsheet application, browser, Email, instant message transrecieving, media player (for example, such as game or mobile application (, " apps ")); And data structure managing application 807.Operating system 805 can be multi-user, multiprocessing, multitask, multithreading, real-time etc.Operating system 805 also can be carried out basic task, and the input such as identification from interface 803, comprises from the input equipment such as keyboard or keypad; To display 802, send output and follow the tracks of file and the catalogue on CRM804; Control ancillary equipment, such as hard drive, printer, image capture device; And the business on management bus 808.Application 806 can comprise the various assemblies that are connected with maintaining network for setting up, such as for realizing communication protocol code or the instruction of (comprising TCP/IP, HTTP, Ethernet, USB and FireWire).

As mentioned above, for nonvolatile memory, such as the data structure managing application of data structure managing application 807, be provided for building/upgrading the various code components of computer-readable system (CRS) framework.In specific example, some or all processing of being carried out by data structure managing application 807 can be integrated in operating system 805.In specific example, process may be at least partially implemented in Fundamental Digital Circuit, in computer hardware, firmware, code, instruction set or its any combination.

According to principle of the present invention, exist and be provided for utilizing the encode of self adaptation context model selection and system, method and the computer-readable medium (CRM) of decoding under sawtooth scan.By utilizing self adaptation context model to select, can reduce the poor efficiency in conversion process under sawtooth scan.These comprise the poor efficiency of the expense based on being associated with computation complexity in addition, the counting that comprises the encode validity conversion coefficient of following the tracks of the Ban Huo upper right, lower-left half be positioned at conversion, the scanning of carrying out branch operation and carry out coefficient in validity mapping encode and decoding is selected.

Although spread all over the whole disclosure, specifically described representative illustration, representative illustration has practicality in very wide range of application, and above-mentioned discussion is not intended to restricted and should be understood to be restricted.Only set forth by way of illustration term, description and accompanying drawing as used herein, and do not mean that restricted.Those of ordinary skill in the art will recognize, within the spirit and scope of the present invention, many modification are possible.Although described example with reference to example, in the situation that do not depart from the scope of the example of claims and equivalent description thereof, can carry out various modifications to described example.

Claims (20)

1. A system for codification, said system comprising: A processor configured to prepare video compression data based on the source picture, the preparation comprising: partitioning the source picture into coding units, generating at least one transform unit having a transform array comprising transform coefficients assigned as entries to y-x positions of the transform array based on residual measurements associated with the coding unit; as well as processing the generated transform units, the processing comprising: generating a validity map having a validity map array having y-x positions corresponding to the y-x positions of the transformation array, scanning a plurality of validity map elements in the validity map array using a zigzag scan pattern, and Using the sawtooth scan pattern to determine a context model for validating the plurality of valid The validity mapping element in the property mapping element is coded. 2. The system according to claim 1, wherein, using a predetermined context model, valid Codification of gender mapping elements. 3. The system of claim 1 , wherein a selected context model is used to encode validity map elements having a y-x position of (0, x>1) in the validity map array, wherein by The y-x position in the validity mapping array is (0, x-1), (0, x-2), (1, x-2) and the y-x position is (1, x- 1) A value associated with at least one neighbor validity map element to determine the selected context model. 4. The system of claim 1 , wherein a selected context model is used to encode validity map elements having a y-x position (y>1,0) in the validity map array, wherein by The y-x position in the validity mapping array is (y-1,0), (y-2,0), (y-2,1) and the y-x position is (y-1, 1) A value associated with at least one neighbor validity map element to determine the selected context model. 5. The system of claim 1 , wherein a selected context model is used to encode validity map elements having a y-x position (y>0, x>0) in the validity map array, wherein at least one neighbor validity with the y-x position in the validity mapping array is (y-1, x-1), (y-1, x), (y, x-1) and the following y-x position The value associated with the map element to determine the selected context model, the y-x position is: In the case of x greater than 1, (y-1,x-2) and (y,x-2); In case x is greater than 1 and y is less than the height of the validity mapping array minus 1, (y+1, x-2); In the case of y greater than 1, (y-2,x-1) and (y-2,x); where y is greater than 1 and x is less than the width of the validity mapping array minus 1, (y-2,x+1); where the sum of x and y is odd and x is less than the width of the validity map array minus 1, (y-1,x+1); and In case the sum of x and y is an even number and y is less than the height of the validity mapping array minus 1, (y+1, x-1). 6. The system of claim 1, wherein processing the generated transform units comprises encoding the validity map elements with the determined context model. 7. The system of claim 1, wherein the residual measure associated with the coding unit is generated based on a predictive process performed on the predictive unit based on the coding unit. 8. The system of claim 1, wherein the validity map and the validity map array sizes are 8×8, 16×16, 32×32, 64×64, 128×128 and 256×256 entries an associated. 9. A method for codification, said method comprising: Using a processor, video compression data is prepared based on the source picture, the preparation comprising: partitioning the source picture into coding units, generating at least one transform unit having a transform array comprising transform coefficients assigned as entries to y-x positions of the transform array based on residual measurements associated with the coding unit; as well as processing the generated transform units, the processing comprising: generating a validity map having a validity map array having y-x positions corresponding to the y-x positions of the transformation array, scanning a plurality of validity map elements in the validity map array using a zigzag scan pattern, and Using the sawtooth scan pattern to determine a context model for validating the plurality of valid The validity mapping element in the property mapping element is coded. 10. A non-transitory computer-readable medium storing computer-readable instructions, when a computer system executes the computer-readable instructions, a method for encoding is performed, the method comprising: Using a processor, video compression data is prepared based on the source picture, the preparation comprising: partitioning the source picture into coding units, generating at least one transform unit having a transform array comprising transform coefficients assigned as entries to y-x positions of the transform array based on residual measurements associated with the coding unit; as well as processing the generated transform units, the processing comprising: generating a validity map having a validity map array having y-x positions corresponding to the y-x positions of the transformation array, scanning a plurality of validity map elements in the validity map array using a zigzag scan pattern, and Using the sawtooth scan pattern to determine a context model for validating the plurality of valid The validity mapping element in the property mapping element is coded. 11. A system for decoding, the system comprising: an interface configured to receive video compressed data; and a processor configured to process the received video compressed data, Wherein, the received video compression data is based on the processed transformation unit, and based on the source picture, the processed transformation unit is prepared through steps including the following: partitioning the source picture into coding units, generating at least one transform unit having a transform array comprising transform coefficients assigned as entries to y-x positions of the transform array based on residual measurements associated with the coding unit; as well as processing the generated transform units, the processing comprising: generating a validity map having a validity map array having y-x positions corresponding to the y-x positions of the transformation array, scanning a plurality of validity map elements in the validity map array using a zigzag scan pattern, and Using the sawtooth scan pattern to determine a context model for validating the plurality of valid The validity mapping element in the property mapping element is coded. 12. The system of claim 11 , wherein a predetermined context model is used to map validity values having y-x positions of one of (0,0), (0,1) and (1,0) in the validity map. Mapping elements are codified. 13. The system of claim 11 , wherein a selected context model is used to encode validity map elements having a y-x position of (0,x>1) in the validity map array, wherein by The y-x position in the validity mapping array is (0, x-1), (0, x-2), (1, x-2) and the y-x position is (1, x- 1) A value associated with at least one neighbor validity map element to determine the selected context model. 14. The system of claim 11 , wherein a selected context model is used to encode validity map elements having a y-x position (y>1,0) in the validity map array, wherein by The y-x position in the validity mapping array is (y-1,0), (y-2,0), (y-2,1) and the y-x position is (y-1, 1) A value associated with at least one neighbor validity map element to determine the selected context model. 15. The system of claim 11 , wherein a selected context model is used to encode validity map elements having a y-x position (y>0, x>0) in the validity map array, wherein at least one neighbor validity with the y-x position in the validity mapping array is (y-1, x-1), (y-1, x), (y, x-1) and the following y-x position The value associated with the map element to determine the selected context model, the y-x position is: In the case of x greater than 1, (y-1,x-2) and (y,x-2); In case x is greater than 1 and y is less than the height of the validity mapping array minus 1, (y+1, x-2); In the case of y greater than 1, (y-2,x-1) and (y-2,x); where y is greater than 1 and x is less than the width of the validity mapping array minus 1, (y-2,x+1); where the sum of x and y is odd and x is less than the width of the validity map array minus 1, (y-1,x+1); and In case the sum of x and y is an even number and y is less than the height of the validity mapping array minus 1, (y+1, x-1). 16. The system of claim 11, wherein processing the generated transform units includes encoding the validity map elements with the determined context model. 17. The system of claim 11, wherein the residual measure associated with a coding unit is generated based on a predictive process performed on the predictive unit based on the coding unit. 18. The system of claim 11, wherein the validity map and validity map array sizes are 8×8, 16×16, 32×32, 64×64, 128×128, and 256×256 entries an associated. 19. A method for decoding, the method comprising: receiving video compressed data; and processing the received video compression data by a processor, Wherein, the received video compression data is based on the processed transformation unit, based on the source picture, and the processed transformation unit is prepared through steps comprising: partitioning the source picture into coding units, generating at least one transform unit having a transform array comprising transform coefficients assigned as entries to y-x positions of the transform array based on residual measurements associated with the coding unit; processing the generated transform units, the processing comprising: generating a validity map having a validity map array having y-x positions corresponding to the y-x positions of the transformation array, scanning a plurality of validity map elements in the validity map array using a zigzag scan pattern, and Using the sawtooth scan pattern to determine a context model for validating the plurality of valid The validity mapping element in the property mapping element is coded. 20. A non-transitory computer-readable medium storing computer-readable instructions, when a computer system executes the computer-readable instructions, a method for decoding is performed, the method comprising: receiving video compressed data; and processing the received video compression data by a processor, Wherein, the received video compression data is based on the processed transformation unit, based on the source picture, and the processed transformation unit is prepared through steps comprising: partitioning the source picture into coding units, generating at least one transform unit having a transform array comprising transform coefficients assigned as entries to y-x positions of the transform array based on residual measurements associated with the coding unit; and processing the generated transform units, the processing comprising: generating a validity map having a validity map array having y-x positions corresponding to the y-x positions of the transformation array, scanning a plurality of validity map elements in the validity map array using a zigzag scan pattern, Using the sawtooth scan pattern to determine a context model for validating the plurality of valid The validity mapping element in the property mapping element is coded.

Images