JP2002245477A - Caricature communication device, transmitter and receiver, transmitter and receiver program, and recording medium storing transmitter and receiver program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portrait communication device which can visually transmit sender's feelings to a recipient with a small amount of data before an electric communication line is connected between terminals. SOLUTION: Included are a transmitter 1 which has a means for specifying expression of feelings that a sender has, a means for generating portrait information corresponding to specified expression, and a means for sending the portrait information and a communication connection establishment request and a receiver 2 which is connected to the transmitter 1 and has a means for receiving the portrait information and communication connection establishment request, a means for drawing a portrait with expression according to the portrait information, and a means for displaying the portrait with the expression.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portrait communication apparatus for transmitting portrait data from a transmitter to a receiver when communication is performed between the transmitter and the receiver.

[0002] The present invention also relates to a transmitter and a receiver in such a portrait communication device. Further, the present invention provides
The present invention relates to a program for realizing the functions of the transmitter and the program for realizing the functions of the receiver, and a recording medium storing these programs.

[0003]

2. Description of the Related Art Conventionally, various telephone apparatuses for displaying a portrait of a sender at the time of an incoming call have been proposed. For example, a telephone device described in Japanese Patent Application Laid-Open No. H11-215223
When an incoming call is received, an icon or portrait that symbolizes the other party is displayed in addition to the other party's name and phone number. This telephone device can intuitively identify the other party who called before the call. However, since the expression of the caller is not known, the emotion of the caller cannot be read.

In the telephone device described in Japanese Patent Application Laid-Open No. 2000-307707, a speech bubble is prepared for a portrait image displayed at the time of an incoming call, and a message such as "Good morning" which matches the date and time of the incoming call, or a message adapted to an individual. Add a message and display it. The message written in the portrait balloon is a fixed message that is stored and designated in the receiving terminal in advance. Therefore, it is not possible to convey the emotions of the caller in real time.

[0005] JP-A-2000-307687 discloses that
A data storage method for displaying a moving image and a telephone device to which the data storage method is applied are disclosed. This telephone device changes the facial expression of the displayed portrait in accordance with the elapse of the telephone calling time. The facial expression created reflects the generally expected feeling that the other party should be angry with longer calling times. Therefore, the intended expression of the other party who made the call cannot be displayed.

[0006]

In contrast to the above prior art, the present invention reduces the emotions of the sender before the connection of the electric communication path is established between terminals such as a portable telephone and a general telephone. An object of the present invention is to provide a caricature communication device that can visually convey to a recipient in an amount.

Further, the present invention provides a transmitter and a receiver for such a communication apparatus, a program for causing a computer to realize the functions of the transmitter and the receiver, and a computer-readable recording medium on which the program is recorded. With the goal.

[0008]

FIG. 1 is a block diagram showing the principle of the present invention. According to the first aspect of the present invention, a portrait communication apparatus of the present invention creates a facial expression information corresponding to a specified facial expression, by a facial expression specifying means 11 for specifying a facial expression representing an emotion such as emotion, emotion, and so on of the sender. A transmitter 1 having a portrait information creating unit 12 and a communication connection establishment requesting unit 13 for transmitting the portrait information and the communication connection establishment request; and a transmitter 1 connected to the transmitter 1 for transmitting the portrait information and the communication connection establishment request. A communication connection establishment request response unit 21 to be received, a portrait drawing unit 22 that draws a facial expression with facial expression based on the portrait information,
And a receiver 2 having a portrait display means 23 for displaying the portrait with the expression.

The portrait communication apparatus of the present invention configured as described above allows the sender to send a request to the receiver when a communication connection establishment request is established before the connection of the electric communication path between the transmitter 1 and the receiver 2 is established. The emotion intended to be conveyed can be conveyed to the receiver by displaying a facial expression with a facial expression on the receiver.

[0010] Further, the present invention is to reduce the amount of information passed from the transmitter to the receiver as much as possible in order to display on the receiver a facial expression with a facial expression representing the intention of the sender. It can be realized by utilizing a small data area before the device and the receiver establish the connection of the electronic communication path.

Therefore, the invention according to claim 2 is characterized in that the coordinate position is determined by an invariant face part coordinate sequence which is a coordinate sequence of a face part whose coordinate position is not changed by an expression such as emotion, emotion and so on. A portrait communication device that uses a portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a changing face part, to display a facial expression with a facial expression corresponding to a facial expression specified on a transmitter side on a receiver side. In addition, the sender transmits a communication connection establishment request to the receiver together with the sender identification ID and the deformation amount of the deformed face part coordinate sequence corresponding to the specified expression. Therefore, claim 2
In the invention according to the first aspect, the deformation of the actual deformed face part coordinate sequence is performed by the receiver.

Further, according to a third aspect of the present invention, there is provided an invariant face part coordinate sequence which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions, and a coordinate position which is determined by expressions such as emotions and emotions. A portrait communication device for displaying a portrait with a facial expression corresponding to a facial expression specified by a sender on a receiver using facial portrait data including a deformed facial part coordinate sequence which is a coordinate sequence of a changing facial part, comprising: And the receiver sends a communication connection establishment request and a transformed face part coordinate sequence after transformation of the transformed face part coordinate string transformed according to the specified expression. Therefore, in the invention according to claim 3, the actual transformation of the transformed face part coordinate sequence is performed by the transmitter.

Further, the invention according to claim 6 is characterized in that an invariant face part coordinate sequence which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions, and a coordinate position is determined by expressions such as emotions and emotions. A portrait communication device for displaying a portrait with a facial expression corresponding to a facial expression specified by a sender on a receiver using facial portrait data including a deformed facial part coordinate sequence which is a coordinate sequence of a changing facial part, comprising: Sends the sender identification ID and a facial expression specifying parameter indicating the specified facial expression together with the communication connection establishment request to the receiver. Therefore, in the invention according to claim 6, the actual deformation of the deformed face part coordinate sequence is performed by the receiver.

Further, according to the present invention, when the expression designation parameter is transmitted from the transmitter 1 to the receiver 2, the receiver 2 is connected to the reception control means 20 and receives the expression designation parameter received from the transmitter 1. From the reception control means 20,
It further includes a ringing tone control means 26 for controlling a ringing tone according to the facial expression specifying parameter. Alternatively, according to the present invention, when transmitting the facial expression specifying parameter from the transmitter 1 to the receiver 2, the receiver 2 The response setting control unit 27 is connected to the control unit 20, receives the expression specifying parameter received from the transmitter 1, from the reception control unit 20, and determines a response to the communication connection establishment request from the transmitter 1 according to the expression specifying parameter. Have more

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Various embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 2 is a block diagram of the portrait communication device according to the first embodiment of the present invention. First, portrait data in the following description of the embodiment will be described. The portrait data is an invariant face part coordinate sequence that is a coordinate sequence of a face part whose coordinate position does not change due to facial expressions such as emotions and sorrows, and a coordinate sequence of a face part whose coordinate position changes according to facial expressions such as emotions and sorrows. It is composed of a deformed face part coordinate sequence. For example, as described in Japanese Patent Application Laid-Open No. 2000-67218, portrait data is represented by coordinates of feature points.
FIG. 3 is an explanatory diagram of an example of such a deformed face part coordinate sequence, and the coordinates of the 39 feature points shown in FIG. 3 correspond to portrait data. The invariant face part coordinate sequence is a coordinate sequence of the face part excluding the deformed face part coordinate sequence in the portrait data, and is a face part that is not deformed even when the facial expression changes (see, for example, JP-A-2000-67218). ) Is a coordinate sequence. FIG. 4 is an explanatory diagram of an example of an invariant face part. In the example shown in the figure, the invariable face part is “hair” indicated by a black area. On the other hand, in the figure, parts other than “hair”, that is, “eyebrows”, “eyes”, “nose”, “mouth”,
“Jaw” is a deformed face part, and its deformed face part coordinate sequence is indicated by a circle.

Japanese Patent Application Laid-Open No. 2000-67218 discloses a method and an apparatus for creating a portrait from a face photograph. In this cited document, a face part of a portrait is recognized as a feature point, and a portrait is created by drawing a figure using the feature point. Also, in Japanese Patent Application No. 2000-041952, there is a technique for creating a portrait that expresses an expression corresponding to an emotion by deforming a feature point, and there is an expression deformation between terminals connected via an electric communication path. It has been proposed to transmit a caricature and display a caricature with a facial expression on a recipient terminal. According to the invention of the present application, JP-A-2000-6
A portrait to be displayed on a receiver is created based on a portrait creation method proposed in Japanese Patent Application No. 7218 and Japanese Patent Application No. 2000-041952.

However, the technique proposed in these cited documents is to transmit a portrait with a deformed facial expression after establishing a connection for communication between terminals connected via an electric communication path, On the local terminal.

Referring again to FIG. 2, the portrait communication apparatus shown in FIG. 2 has a transmitter 1 having a transmitting section 13 for transmitting a communication connection establishment request and a receiving section 21 for receiving the communication connection establishment request. And a receiver. Then, an invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
A facial caricature with a facial expression corresponding to the facial expression specified by the sender is received by using facial caricature data including a deformed facial part coordinate sequence, which is a coordinate sequence of a facial part whose coordinate position changes depending on facial expressions such as emotions and emotions. 2 is displayed.

The transmitter 1 has an input interface unit 14 from which a user can input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver. The facial expression designation parameter is a value indicating the facial expression of the portrait that the sender wants to display on the receiver, and the sender can change the facial expression designation parameter to laugh, cry, anger, and enjoy. The user can select various expressions having different eye opening / closing degrees and mouth opening / closing degrees. FIG. 5 is a diagram showing an example of a facial expression corresponding to the facial expression designation parameters (01 to 32).

The transmitter 1 has a transformation rule storage unit 31 in which a pair of a facial expression designating parameter and a transformation amount of a deformed face part coordinate sequence corresponding to the facial expression designating parameter is stored.
The input expression specifying parameter is transmitted to the transmission control unit 1 described later.
0 to the transformation rule storage unit 31. The deformation rule storage unit 31 stores a deformation amount of a deformed face part coordinate sequence for deforming to a facial expression corresponding to a facial expression specifying parameter. FIG. 6 is an explanatory diagram of an example of the deformation rule storage unit 31 in which the expression specifying parameter and the deformation amount are associated. In the example shown in the figure, the amount of deformation of the eyebrows (a1,
a2, a3) and the amount of eye deformation (b1, b2, b3, b)
4, b5) and the amount of mouth deformation (c1, c2, ..., c1)
7) is defined, and the amount of deformation can be obtained from the expression specifying parameter.

Further, the transmitter 1 stores a sender identification ID storage unit 15 in which the sender identification ID is stored, and a deformation amount corresponding to the expression designating parameter input from the input interface unit 14 into a deformation rule storage unit 31. From the input interface unit 14, the sender identification ID from the sender identification ID storage unit 15, and the amount of deformation from the deformation rule storage unit to the transmission unit 13.
And Note that the transmission control unit 10 of the transmitter 1 is simply described as the control unit 10 in the drawing.

Before establishing a connection for communication, the transmitting unit 13
Before establishing a connection in communication by telephone such as a telephone or communication by a computer system such as a chat, the recipient identification I
In order to transmit the sender ID and the amount of deformation to the receiver 2 corresponding to D, the sender ID and the amount of deformation are transmitted to the receiver 2 specified by the receiver ID together with the communication connection establishment request. FIG. 7 shows a sequence chart up to the establishment of the communication connection. In this example, the transmitter 1 transmits a sender identification ID and a deformation amount together with a connection establishment request message.

FIG. 8 is a sequence chart up to the establishment of a communication connection in the case of ISDN. For example, I
In the case of an SDN fixed telephone, when an incoming call is received, the transmitter 1
By using the user / user information area included in the call setting message sent from the to the receiver 2, the information of the sender identification ID and the deformation amount can be transmitted.

In the present invention, the form of communication between the transmitter 1 and the receiver 2 is not limited to the example of ISDN.
The present invention relates to a wired telephone such as an analog line or an ISDN line, a wireless telephone such as a mobile phone, a PHS or a car telephone, a direct communication between terminals such as an infrared communication or a Bluetooth,
Alternatively, it should be noted that the present invention can be applied to various communication modes such as the Internet and dedicated communication such as IP communication.

The receiver 21 of the receiver 2 receives the sender ID and the amount of deformation together with the communication connection establishment request from the transmitter 1. The receiver 2 receives the received sender identification ID.
And a reception control unit 20 for determining the amount of deformation. In the drawing, the reception control unit 20 of the receiver 2 is simply a control unit 2.
0 is described.

The receiver 2 has a portrait data storage unit 32 in which a pair of a sender ID and a portrait data of the sender corresponding to the sender ID is stored. According to an embodiment of the present invention, the portrait data is created by the portrait data creation device in the transmitter or an external server,
The data is stored in the portrait data storage unit 32 of the receiver by directly communicating between the transmitter and the receiver or via a server.

The receiver 2 further includes an expression transformation unit 33 for transforming the transformed face part coordinate sequence extracted from the portrait data storage unit with the transformation amount from the reception control unit 20 in order to obtain a transformed face part coordinate sequence after transformation. Have.

Hereinafter, an example of the deformation rule in the embodiment of the present invention will be described. In the following description, the positive direction of the x-axis corresponds to the rightward direction in the horizontal direction of the face image, and the y-axis direction corresponds to the upward direction in the vertical direction of the face image. Also, the deformation parameters are symmetrical about the center of the face image, and the parameter values in the y-axis direction are the same for the corresponding left and right feature points.
It should be noted that the sign of the parameter value in the x-axis direction is inverted with respect to the corresponding left and right feature points.

The deformation parameter for deforming the feature point of the eyebrow part is the vertical movement amount a for all the feature points of the eyebrow part.
1, a horizontal movement amount a2, and a rotation amount a3 around the inner end point. The deformation parameters a1 and a2 are movements when the height of the entire face area including the hair is set as a reference (= 1.0). The quantity (<1.0), ie, the ratio, and the unit of a3 is degree.

The deformation parameter for deforming the feature point of the eye part is a vertical movement amount b for all the feature points of the eye part.
1 and the horizontal movement amount b2, the vertical movement amounts b3 and b4 of the upper and lower points, and the rotation amount b5 around the inner end point of the feature point. The deformation parameters b1 and b2 are movement amounts (<1.0) when the height of the entire face area including the hair is set as a reference (= 1.0), that is, ratios, and the deformation parameters b3 and b4 are The vertical movement amount when the eye height obtained as a recognition result is 1.0, and the unit of the deformation parameter b5 is degrees.

The deformation parameters for deforming the feature point of the mouth part include a vertical movement amount c1 of the upper lip center point, a vertical movement amount c2 of the lower lip center point, and a horizontal movement amount c2 of the right lip end point.
3, the horizontal movement amount c4 of the lip left end point, the tangent vectors c5 and c6 from the lip right end point to the upper lip direction, the tangent vectors c7 and c8 from the lower lip direction, and the tangent vector from the lip left end point to the upper lip direction c9, c10 and tangent vectors c11 and c12 in the lower lip direction, lengths c13 and c14 of tangent vectors in the left and right horizontal direction from the upper lip center point, and tangent vectors in the left and right horizontal direction from the lower lip center point. The lengths c15 and c16 and the total vertical movement amount c17 of the mouth part. The deformation parameters c11 to c12 are movement amounts when the width of the original mouth is set to 1, and are the deformation parameters c13 to c12.
c16 is an absolute quantity (dimensionless), and the deformation parameter c1
Reference numeral 7 denotes a movement amount with respect to a value where the vertical length of the face and hair is set to 1.0.

Hereinafter, the operation of the facial expression transformation unit 33 will be described with reference to the flowchart of the transformation processing in the facial expression transformation unit 33 shown in FIGS. 9A to 9F.

FIG. 9A is a flowchart of eyebrow deformation processing. The eyebrow deformation processing is performed symmetrically. Therefore, for example, first, all the feature points of the left eyebrow are moved a1 in the y-axis direction (step 210), and then, all the feature points of the left eyebrow are moved a2 in the x-axis direction (step 212). The order of execution of step 210 and step 212 is out of order. Subsequently, all the feature points of the left eyebrow are rotated by a3 degrees around the left eyebrow inner end point 12 (step 214). Subsequently, in step 216, the same processing as in steps 210, 212 and 214 for the left eyebrow is executed for the right eyebrow. Either of the processes for the right eyebrow and the left eyebrow may be performed first, or they may be performed simultaneously in parallel.

FIG. 9B is a flowchart of the eye deformation processing. The eye deformation processing is also performed symmetrically as in the eyebrow deformation processing. For example, first, all the feature points of the left eye part are moved in the vertical direction by the movement amount b1 (step 22).
0) Then, all the feature points of the left eye part are moved in the horizontal direction by the movement amount b2 (step 222), and the upper left point 26 of the left eye is moved by the movement amount b3 in the vertical direction (step 224), and the lower end point of the left eye is moved. 28 is moved in the vertical direction by a movement amount b4 (step 226), and all feature points of the left eye are rotated around the inner end point 27 by a rotation amount b5 (step 228). Next, the same deformation processing as the deformation processing steps 220 to 228 for the left eye is performed on the right eye (step 23).
0).

FIG. 9C is a flowchart of the mouth deformation process. In the mouth deformation process, for example, first, the upper lip center point 32 is moved in the vertical direction by the movement amount c1 (step 24).
0), the lower lip center point 32 'is moved in the vertical direction by the movement amount c2 (step 242), the lip right end point 33 is moved in the horizontal direction by the movement amount c3 (step 244), and the lip left end point 34 is moved in the horizontal direction. Is moved by the movement amount c4 (step 246). The steps so far are in no particular order. Then, lip right end point 3
The tangent vector from 3 to the upper lip direction is represented by tangent vector c5,
c6 (step 248), tangent vectors from the lip right end point 33 toward the lower lip are set as tangent vectors c7 and c8 (step 250), and tangent vectors from the lip left end point 34 toward the upper lip are set as the tangent vector c9. , C10 (step 252), and tangent vectors from the lip left end point 34 toward the lower lip are set as tangent vectors c11 and c12 (step 254). Further, the lengths c13 and c14 of the tangent vectors in the horizontal direction from the upper lip center point 32 to the left and right are set (step 256), and the lengths c15 and c16 of the tangent vectors in the horizontal direction from the lower lip center point 32 'to the left and right are set. Is set (step 258). Finally, all feature points of the mouth part are moved in the vertical direction by the movement amount c17 (step 260). FIG. 9D illustrates a tangent vector set in the mouth deformation process.

FIG. 9E is a flowchart of the jaw deformation process. In the jaw deformation process, the lowermost point 37 of the jaw is moved in the vertical direction by the movement amount d1 (step 270), and the point of contact 3 with the contour is moved.
6 and 38 are moved in the vertical direction by a movement amount d2 (step 272). These deformation parameters d1 and d2 are:
It may be read from the deformation database for jaw parts,
In one preferred embodiment of the invention, this deformation parameter d
1 and d2 are distances e1 from the mouth to the lowest point 37 of the chin.
And the distance e2 from the mouth to the contact point 36 (or 38) is calculated as d1 = c1 d2 = e2 · d1 / e1. FIG. 9F shows a relationship between jaw deformation parameters d1 and d2 and distances e1 and e2 from the mouth. As shown in the figure, e2 / e1 = (e2 + d2) / (e1 + d1). By modifying this equation, d2 = e2 · d1 / e1 is obtained.

The receiver 2 further includes a drawing rule storage unit 25 in which a drawing rule for drawing a face part from the transformed face part coordinate sequence and the invariant face part coordinate sequence is stored, and a facial expression transformation unit 33.
A drawing unit 24 that draws a facial expression with a facial expression by applying a drawing rule to the deformed face part coordinate sequence after transformation and the invariant facial part coordinate sequence from the portrait data storage unit 32; and a facial expression with a facial expression drawn by the drawing unit 24 The following is an example of a drawing rule employed in the embodiment of the present invention, which has a display unit 23 for displaying.

The eyebrow part is drawn for each of the left and right eyebrows with three ellipses passing through feature points defining each of the three equally divided regions, and an eyebrow polygon is output. More specifically, the feature points (1, 3, 4, 5) of the right eyebrow, the feature points (5, 6, 8, 7),
Three ellipses passing through the feature points (8, 9, 2, 10) are created. The ellipse is enlarged to smoothly connect the three ellipses. For example, of the three ellipses, the ellipses on both sides are expanded inward, and the ellipse in the middle is expanded on both sides. The left eyebrow is drawn similarly.

The eye part is drawn for each of the left and right eyes by an elliptic arc passing through the outer end point and the upper end point, an elliptical arc passing through the inner end point and the upper end point, and a circle passing through the upper end point and the lower end point. Is done. That is, the eye is a quarter elliptical arc 2
And a circle. More specifically, the right eye is composed of two quadrant elliptical arcs passing through the feature points (21, 22) and (22, 23) on the upper eyelid, and the feature points (22, 2) on the pupil.
It is drawn with a circle whose diameter is 4). The left eye is drawn similarly.

The mouth part includes a lip left end point, an upper lip center point, a lip right end point, a tangent vector from the lip left end point to the upper lip direction,
A tangent vector from the lip right end point to the upper lip direction, and a spline curve defined by a tangent vector from the upper lip center point to the left and right horizontal direction, and the lip left end point, the lower lip center point, and the lip right end point, It is drawn by a spline curve defined by a tangent vector from the lip left end point to the lower lip direction, a tangent vector from the lip right end point to the lower lip direction, and a tangent vector from the lower lip center point to the left and right horizontal directions, The mouth polygon is output.

The jaw part includes a contact point between the straight line passing through the left end point of the lip and the right end point of the lip and the left contour of the face and a contact point of the right contour of the face, the lowest point of the chin, and the left contour of the face across the center point of the upper lip. The bisector of the angle formed by the contact point and the contact point on the right side of the face with the lowermost point of the chin is drawn as a spline curve passing through the intersection point intersecting the left contour of the face and the right contour of the face, and a chin polygon is output.

The nose part is drawn as a half elliptical arc passing through the left end point of the nose, the lower end point of the nose, and the right end point of the nose, and a nose polygon is output.

The hair part is drawn with a contour passing through the hair feature point, and a hair polygon is output. When drawing hair parts,
The face outline may be drawn by an outline.

The drawing operation in the drawing unit 24 will be described with reference to the flowchart of the drawing unit 24 in FIGS. 10A to 10C.

FIG. 10A is a flowchart of eyebrow drawing processing for one of the left and right eyebrows. Extract the maximum and minimum values of the x-coordinate of the rectangle surrounding the region where the eyebrow component exists (Step 3)
20), this area is divided into three equal parts (step 322), and the maximum and minimum values of the y coordinate are extracted in each divided area (step 324). Next, the midpoint of the eyebrow area on the dividing line is extracted (step 326), and the one obtained in steps 320 to 324 for the eyebrow part is extracted.
Three ellipses that pass through zero points are drawn (step 328).

FIG. 10B is a flowchart of eye drawing processing for one of the left and right eyes. The maximum and minimum values of the x coordinate of the rectangle surrounding the region where the eye part is present are extracted (step 3).
30), extract the maximum and minimum values of the y coordinate (step 3)
32) Using these four points, a quarter elliptical arc and a circle are drawn (step 334).

FIG. 10C is a flowchart of the nose drawing process. The maximum and minimum values of the x-coordinate of the rectangle surrounding the nose region are extracted (step 340), and then the minimum value of the y-coordinate is extracted (step 342).
Draw a half-elliptical arc using the points (step 34)
4).

As described above, in the first embodiment of the present invention,
It is characterized in that the transmitter 1 and the receiver 2 are transferred with the communication connection establishment request and the sender identification ID and the deformation amount of the deformed face part coordinate sequence corresponding to the specified expression.
Therefore, the deformation of the actual deformed face part coordinate sequence is performed by the receiver 2
Done in

FIG. 11 is a block diagram of a portrait communication apparatus according to a second embodiment of the present invention. The portrait communication device according to the second embodiment of the present invention shown in FIG. 11 is similar to the portrait communication device according to the first embodiment of the present invention shown in FIG. Throughout the drawings, the same or equivalent components are denoted by the same reference numerals.

The difference between the second embodiment and the first embodiment is that
In the case of the embodiment, the transmission unit 13 of the transmitter 1 transmits the sender identification I
In addition to D and the amount of deformation, the receiving unit 21
The receiver 1 is provided with a ringing tone controller 26. The receiver 21 of the receiver 2 receives the expression specifying parameter in addition to the sender identification ID and the deformation amount.
0, the facial expression designating parameter is passed to the ringing tone control unit 26, and the ringing tone control unit 26 changes the ringing tone size, ringing tone pitch, and ringing tone type according to the facial expression designating parameter. It is.

For example, when a facial expression designating parameter indicating a facial expression “large opening” is sent, the ringing tone control unit 26 increases the volume of the ringing tone and expresses the facial expression with a large “degree of laughter”. When the facial expression designating parameter indicating is transmitted, the pitch of the ringing tone is raised.

FIG. 12 is a block diagram of a portrait communication apparatus according to a third embodiment of the present invention. The portrait communication device according to the third embodiment of the present invention shown in FIG. 12 is similar to the portrait communication device according to the first embodiment of the present invention shown in FIG.

The difference between the third embodiment and the first embodiment is that
In the case of the embodiment, the transmission unit 13 of the transmitter 1 transmits the sender identification I
In addition to D and the amount of deformation, the receiving unit 21
The receiver 1 is provided with a response setting control unit 27, and the receiving unit 21 of the receiver 2 receives the expression specifying parameter in addition to the sender identification ID and the deformation amount.
0 to the response setting control unit 27
In this case, the response setting control unit 27 changes the response behavior such as call rejection or answering machine response according to the expression specification parameter.

When, for example, a facial expression designating parameter indicating a facial expression having a large “degree of anger” has been sent, the response setting control unit 27 selects a response to reject incoming calls. Figure 1
3 is a sequence chart up to the rejection of the incoming call. The receiver 2 rejects the incoming call by returning a connection establishment rejection message to the transmitter 1 instead of the connection establishment request confirmation message.

FIG. 14 is a block diagram of a portrait communication apparatus according to a fourth embodiment of the present invention. Referring to FIG. 14, the portrait communication apparatus shown in FIG. 14 includes a transmitter 1 having a transmission unit 13 for transmitting a communication connection establishment request and a receiver having a reception unit 21 for receiving the communication connection establishment request. Is done. Then, an invariant face part coordinate sequence that is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions, and a deformed face that is a coordinate sequence of a face part whose coordinate position changes according to expressions such as emotions and emotions Using the portrait data including the part coordinate sequence, the receiver 2 displays a facial expression with a facial expression corresponding to the facial expression specified by the sender.

In the fourth embodiment of the present invention, a sender identification ID is transmitted from a transmitter 1 to a receiver 2 together with a communication connection establishment request.
And transmitting a post-deformation deformed face part coordinate sequence of a deformed face part coordinate string deformed in accordance with the designated expression. Therefore, the actual deformation of the deformed face part coordinate sequence is different from that of the first embodiment in that it is performed by the transmitter 1.

In the fourth embodiment of the present invention, the transmitter 1
The input interface unit 14 allows a user to input a recipient identification ID and a facial expression specifying parameter indicating a facial expression to be displayed on the receiver, and a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter. A transformation rule storage unit 31 in which pairs are stored, a sender identification ID storage unit 15 in which sender identification IDs are stored, a self-portrait data storage unit 34 in which portrait data of the sender is stored, The transformation amount corresponding to the expression specifying parameter input from the interface unit 14 is stored in the transformation rule storage unit 3
1 to obtain a post-deformation deformed face part coordinate sequence, and transforms the deformed face part coordinate sequence extracted from the self-portrait data storage unit 34 by the obtained deformation amount, and receives from the input interface unit. Sender ID, Sender ID from Sender ID Storage Unit 15 and Expression Deformation Unit 3
And a transmission control unit 10 for transmitting the post-deformation deformed face part coordinate sequence from the transmission unit 13 to the transmission unit 13.

The transmitting unit 13 transmits the sender identification ID and the deformed face part coordinate sequence together with the communication connection establishment request to the receiver 2 specified by the receiver identification ID. The receiver 21 of the receiver 2 receives the sender identification ID and the deformed face part coordinate sequence from the transmitter 1 together with the communication connection establishment request.

The receiver 2 separates the received sender identification ID and the transformed deformed face part coordinate sequence from each other.
And a portrait data storage unit 32 in which a pair of a portrait image data of the sender corresponding to the sender identification ID and the sender identification ID is stored, and a face part is drawn from the deformed face part coordinate sequence and the invariant face part coordinate sequence. A drawing rule is stored in the drawing rule storage unit 25 in which the drawing rule is stored, and the transformed face part coordinate sequence from the reception control unit 20 and the invariant face part coordinate sequence from the portrait data storage unit. It further includes a drawing unit 24 for drawing and a display unit 23 for displaying a portrait with a facial expression drawn by the drawing unit 24.

The detailed functions of the respective components of the transmitter 1 and the receiver 2 of the portrait communication apparatus according to the fourth embodiment of the present invention have already been described with reference to the first embodiment of the present invention. Omitted.

FIG. 15 is a block diagram of a portrait communication apparatus according to a fifth embodiment of the present invention. The portrait communication device according to the fifth embodiment of the present invention shown in FIG. 15 is similar to the portrait communication device according to the fourth embodiment of the present invention shown in FIG.

The difference between the fifth embodiment and the fourth embodiment is that
In the case of the embodiment, the transmission unit 13 of the transmitter 1 transmits the sender identification I
In addition to D and the deformed face part coordinate sequence, the facial expression specification parameter is transmitted to the receiving unit 21. The receiver 1 is provided with a ringing tone control unit 26, and the receiving unit 21 of the receiver 2 In addition to the identification ID and the deformation amount, a facial expression specifying parameter is received, and the facial expression specifying parameter is passed to the ringing tone control unit 26 via the reception control unit 20, and the ringing tone control unit 26 responds to the ringing tone according to the facial expression specifying parameter. The size, the pitch of the ringing tone, and the type of the ringing tone are changed.

FIG. 16 is a block diagram of a portrait communication apparatus according to a sixth embodiment of the present invention. The portrait communication device according to the sixth embodiment of the present invention shown in FIG. 14 is similar to the portrait communication device according to the fourth embodiment of the present invention shown in FIG.

The difference between the sixth embodiment and the fourth embodiment is that
In the case of the embodiment, the transmission unit 13 of the transmitter 1 transmits the sender identification I
In addition to D and the deformed face part coordinate sequence, the facial expression specification parameter is transmitted to the receiver 21. The receiver 1 is provided with a response setting controller 27, and the receiver 21 of the receiver 2 In addition to the identification ID and the amount of deformation, an expression specification parameter is received, and the expression specification parameter is passed to the response setting control unit 27 via the reception control unit 20, and the response setting control unit 27 receives an incoming call according to the expression specification parameter. The point is to change the behavior at the time of answering such as refusal and answering machine.

FIG. 17 is a block diagram of a portrait communication apparatus according to a seventh embodiment of the present invention. Referring to FIG. 17, the portrait communication apparatus shown in FIG. 17 includes a transmitter 1 having a transmission unit 13 for transmitting a communication connection establishment request and a receiver having a reception unit 21 for receiving the communication connection establishment request. Is done. Then, an invariant face part coordinate sequence that is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions, and a deformed face that is a coordinate sequence of a face part whose coordinate position changes according to expressions such as emotions and emotions Using the portrait data including the part coordinate sequence, the receiver 2 displays a facial expression with a facial expression corresponding to the facial expression specified by the sender.

In the seventh embodiment of the present invention, the sender 1 transmits a communication connection establishment request to the receiver 2 together with a sender identification ID.
And a facial expression designation parameter indicating the designated facial expression. For this reason, the seventh embodiment differs from the first embodiment in that acquisition of the amount of deformation and deformation of the actual deformed face part coordinate sequence are performed by the receiver.

In the seventh embodiment of the present invention, the transmitter 1 comprises: an input interface unit 14 which allows a user to input a receiver identification ID and an expression designating parameter indicating an expression to be displayed on the receiver; Is stored in the sender identification ID storage unit 15, the receiver identification ID and the facial expression designation parameter from the input interface unit 14, and the sender identification ID from the sender identification ID storage unit 15.
And a transmission control unit 10 for transferring the information to the transmission control unit 3.

The transmitting unit 13 transmits the sender ID and the expression specifying parameter together with the communication connection establishment request to the receiver 2 specified by the receiver ID, and the receiving unit 21 of the receiver 2 transmits the communication from the transmitter. The sender identification ID and the expression specifying parameter are received together with the connection establishment request.

The receiver 2 stores a pair of a sender identification ID and a portrait image data of the sender corresponding to the sender identification ID and the sender identification ID. Caricature data storage unit 32
A transformation rule storage unit 31 in which a pair of a facial expression designating parameter and a transformation amount of a transformed facial part coordinate sequence corresponding to the facial expression designation parameter is stored; and a transformation rule storage unit 31 for obtaining a transformed facial part coordinate sequence after transformation. An expression transformation unit 33 for transforming the transformed face part coordinate sequence extracted from the portrait data storage unit 32 with the transformation amount corresponding to the expression designation parameter from the reception control unit 20 stored in the received control unit 20; A drawing rule storage unit 25 in which a drawing rule for drawing a face part from a face part coordinate sequence is stored; a deformed deformed face part coordinate sequence and a portrait data storage unit 32 from an expression deformation unit 33
And a display unit 23 for displaying the facial expression with the facial expression drawn by the drawing unit 24 by applying the facial drawing rule to the invariant facial part coordinate sequence from.

The detailed functions of the components of the transmitter 1 and the receiver 2 of the portrait communication apparatus according to the seventh embodiment of the present invention have already been described with reference to the first embodiment of the present invention. Omitted.

FIG. 18 is a block diagram of a portrait communication apparatus according to an eighth embodiment of the present invention. The portrait communication device according to the eighth embodiment of the present invention shown in FIG. 18 is similar to the portrait communication device according to the seventh embodiment of the present invention shown in FIG.

The difference between the eighth embodiment and the seventh embodiment is that
In the case of this embodiment, the receiver 1 is provided with a ringer controller 26, and the receiver 21 of the receiver 2 passes the expression designation parameter to the ringer controller 26 via the receiver controller 20, and the ringer controller Reference numeral 26 denotes that the magnitude of the ringing tone, the pitch of the ringing tone, and the type of the ringing tone are changed in accordance with the expression specifying parameter.

FIG. 19 is a block diagram of a portrait communication apparatus according to a ninth embodiment of the present invention. The portrait communication device according to the ninth embodiment of the present invention shown in FIG. 19 is similar to the portrait communication device according to the seventh embodiment of the present invention shown in FIG.

The difference between the ninth embodiment and the seventh embodiment is that
In the case of the embodiment, the receiver 1 is provided with a response setting control unit 27, and the receiving unit 21 of the receiver 2 passes the expression specifying parameter to the response setting control unit 27 via the reception control unit 20, and the response setting control unit 27 is that the response behavior such as rejection of incoming calls and answering machine response is changed according to the expression specifying parameter.

The portrait communication apparatus according to the embodiment of the present invention is not limited to the example described in the above embodiment, but may be an input / output device in a system or a computer CP.
Parts other than hardware parts such as U and memory are constructed by software (program) that realizes equivalent functions, recorded in a disk device or the like, and installed on a computer as necessary, or via a network. It is also possible to carry out portrait communication by downloading to a computer. Further, the constructed program is transferred to a floppy (registered trademark) disk, a memory card, a CD-R.
It is also possible to store it in a portable recording medium such as OM or the like and use it versatilely when using such a system.

The representative embodiments of the present invention have been described above. However, the present invention is not limited to the above embodiments, and various modifications and applications are possible within the scope of the claims.

[0077]

According to the present invention, when a call is received between terminals such as a portable telephone and a general telephone, a portrait in which the facial expression of the basic facial expression corresponding to the caller is changed is transmitted to the receiving terminal. Is displayed, the callee can know the caller and the emotion of the caller before the call starts, so that smooth communication between the caller and the callee can be achieved.

The present invention has the following effects.

(1) Before establishing a connection for communication, that is, before establishing a connection in communication by telephone call or communication by a computer system such as chat, an expression intended by the sender is required. Can be displayed on the recipient terminal. Thereby, regardless of the presence or absence of subsequent communication, the emotion of the sender can be transmitted to the receiver.

(2) Also, since a deformed image intended by the sender can be viewed on the sender terminal before a connection for communication is established, it is determined whether or not to respond to the communication request by referring to this image. Since the sender and the receiver can share feelings, subsequent communication becomes smooth.

(3) Further, since the deformed expression intended by the sender is sent to the receiver before the connection for communication is established, the receiver can enjoy the expression sent from the sender. Using the degree of anger and pleasure,
On the condition of who the sender is and what kind of emotional state the sender is in, it is possible to set what kind of operation the receiving terminal performs when receiving a call. That is, the receiver can selectively perform operations such as rejection of an incoming call and answering by answering machine according to the emotion of the sender.

(4) It is possible to visually and accurately convey the emotion of the sender to the receiver with a much smaller data transmission amount than actually transmitting the photographic image data.

[Brief description of the drawings]

FIG. 1 is a principle configuration diagram of the present invention.

FIG. 2 is a configuration diagram of a portrait communication device according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram of an example of a deformed face part coordinate sequence.

FIG. 4 is an explanatory diagram of an example of an invariant face part.

FIG. 5 is an explanatory diagram of an example of a facial expression corresponding to a facial expression designation parameter.

FIG. 6 is an explanatory diagram of a transformation rule storage unit in which a facial expression designation parameter and a transformation amount are associated;

FIG. 7 is a sequence chart until a communication connection is established according to the first embodiment of the present invention.

FIG. 8 is a sequence chart until a communication connection is established in the case of ISDN according to the first embodiment of the present invention.

FIG. 9A is a flowchart of eyebrow deformation processing.

FIG. 9B is a flowchart of eye deformation processing.

FIG. 9C is a flowchart of a mouth deformation process.

FIG. 9D is an explanatory diagram of a connection vector of a mouth.

FIG. 9E is a flowchart of a jaw deformation process.

FIG. 9F is an explanatory diagram of jaw part deformation parameters.

FIG. 10A is a flowchart of eyebrow drawing processing.

FIG. 10B is a flowchart of an eye drawing process.

FIG. 10C is a flowchart of a nose drawing process.

FIG. 11 is a configuration diagram of a portrait communication device according to a second embodiment of the present invention.

FIG. 12 is a configuration diagram of a portrait communication device according to a third embodiment of the present invention.

FIG. 13 is a sequence chart until a call is rejected according to the third embodiment of the present invention.

FIG. 14 is a configuration diagram of a portrait communication device according to a fourth embodiment of the present invention.

FIG. 15 is a configuration diagram of a portrait communication device according to a fifth embodiment of the present invention.

FIG. 16 is a configuration diagram of a portrait communication device according to a sixth embodiment of the present invention.

FIG. 17 is a configuration diagram of a portrait communication device according to a seventh embodiment of the present invention;

FIG. 18 is a configuration diagram of a portrait communication device according to an eighth embodiment of the present invention.

FIG. 19 is a configuration diagram of a portrait communication device according to a ninth embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Transmitter 2 Receiver 10 Transmission control part 13 Transmission part 14 Input interface part 15 Sender ID storage part 20 Reception control part 21 Reception part 23 Display part 24 Drawing part 25 Drawing rule storage part 31 Deformation rule storage part 32 Portrait data Storage unit 33 Expression transformation unit

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Naoya Kotani 2-3-1 Otemachi, Chiyoda-ku, Tokyo Nippon Telegraph and Telephone Corporation F-term (reference) 5B050 BA07 BA12 CA05 CA06 CA07 EA12 EA13 EA19 FA02 FA08 FA19 GA07 5B057 CA12 CB12 CD01 CE08 5K067 BB04 FF23 FF31

Claims (26)

[Claims] 1. A facial expression designating means for designating a facial expression representing an emotion of a sender, such as emotions, emotions and so on, a portrait information creating means for producing portrait information corresponding to the designated facial expression, and the portrait information and communication connection establishment. A transmitter having communication connection establishment request means for transmitting a request, a communication connection establishment request response means connected to the transmitter and receiving the portrait information and the communication connection establishment request, and a facial expression with an expression based on the portrait information And a receiver having a portrait display means for displaying the facial expression with the facial expression. 2. A communication apparatus comprising: a transmitter having a transmitting means for transmitting a communication connection establishment request; and a receiver having a receiving means for receiving the communication connection establishment request, wherein the coordinate position does not change due to expressions such as emotions, emotions and so on. Using the portrait image data including the invariant face part coordinate sequence that is the coordinate sequence of the face part, and the deformed face part coordinate sequence that is the coordinate sequence of the face part whose coordinate position changes according to expressions such as emotions,
A portrait communication device for displaying a facial expression with a facial expression corresponding to a facial expression specified by a sender on a receiver, wherein the transmitter has a user identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver. Input interface means that can be input from the PC, transformation rule storage means for storing a pair of a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter, and a sender identification ID. A sender identification ID storage unit, and an amount of deformation corresponding to a facial expression specification parameter input from the input interface unit are extracted from the deformation rule storage unit, and the receiver identification ID and the sender identification ID from the input interface unit are extracted. The sender identification ID from the storage unit and the amount of deformation from the deformation rule storage unit are passed to the transmission unit. Further comprising a transmission control unit, the said transmission means, the recipient the sender identification ID and the deformation amount with the communication connection establishment request identification I
D, the receiving means of the receiver receives the sender identification ID and the deformation amount together with the communication connection establishment request from the transmitter, and the receiver receives the Receiving control means for separating the sender identification ID and the deformation amount; caricature data storage means for storing a pair of the sender identification ID and the caricature data of the sender corresponding to the sender identification ID; Expression transformation means for transforming the transformed face part coordinate sequence extracted from the portrait data storage means by the transformation amount from the reception control unit in order to obtain a transformed face part coordinate sequence, a transformed face part coordinate sequence and an invariant face part coordinate A drawing rule storage unit in which a drawing rule for drawing a face part from a column is stored; and a post-deformation deformed face part coordinate sequence from the expression deformation unit and the portrait data storage unit. Further comprising, portrait communication device and invariant face parts drawing means to coordinate sequence by applying the rendering rule for drawing the facial expression with portrait, and display means for displaying the rendered facial expression with a portrait by the drawing means, the. 3. A coordinate system comprising a transmitter having a transmitting means for transmitting a communication connection establishment request and a receiver having a receiving means for receiving the communication connection establishment request, wherein the coordinate position does not change due to expressions such as emotions, emotions and so on. Using the portrait image data including the invariant face part coordinate sequence that is the coordinate sequence of the face part, and the deformed face part coordinate sequence that is the coordinate sequence of the face part whose coordinate position changes according to expressions such as emotions,
A portrait communication device for displaying a facial expression with a facial expression corresponding to a facial expression specified by a sender on a receiver, wherein the transmitter has a user identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver. Input interface means that can be input from the PC, transformation rule storage means for storing a pair of a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter, and a sender identification ID. Sender identification ID storage means, self-portrait data storage means for storing portrait data of the sender, and a deformation amount corresponding to the facial expression designation parameter input from the input interface means are obtained from the deformation rule storage means. In order to obtain a transformed face part coordinate sequence after transformation, the transformed face part coordinate sequence A facial expression deformation means deforms obtained by deformation amount, the recipient identification I from said input interface means
D, transmission control means for transmitting the sender identification ID from the sender identification ID storage means and the post-deformation deformed face part coordinate sequence from the facial expression deformation means to the transmission means, and Transmits the sender identification ID and the post-deformation deformed face part coordinate sequence together with the communication connection establishment request to a receiver specified by the receiver identification ID, and the receiving means of the receiver includes: Receiving the sender identification ID and the post-transformation deformed face part coordinate sequence together with the communication connection establishment request from the communication device, and receiving the received sender identification ID and the post-transformation deformed face part coordinate sequence. Control means; a portrait identification data storage means in which a pair of a sender identification ID and a portrait portrait data of the sender corresponding to the sender identification ID are stored; A drawing rule storage unit in which a drawing rule for drawing a face part from the product coordinate sequence is stored; and a post-transformation deformed face part coordinate sequence from the reception control unit and an invariant face part coordinate sequence from the portrait data storage unit. A portrait communication device further comprising: drawing means for drawing a portrait with a facial expression by applying the drawing rule; and display means for displaying the portrait with a facial expression drawn by the drawing means. 4. The expression specifying parameter input from the input interface means is additionally transmitted from the transmission means of the transmitter to the reception means of the receiver, and the receiver is connected to the reception control means. 4. The caricature apparatus according to claim 2, further comprising: a ring tone control unit that receives the expression designation parameter received from the transmitter from the reception control unit, and controls a ring tone according to the expression designation parameter. 5. The expression specifying parameter input from the input interface means is additionally transmitted from the transmission means of the transmitter to the reception means of the receiver, and the receiver is connected to the reception control means. Further comprising: response setting control means for receiving the expression specifying parameter received from the transmitter from the reception control means, and determining a response to the communication connection establishment request from the transmitter according to the expression specification parameter. Item 4. The portrait painting apparatus according to item 2 or 3. 6. A transmitter having a transmitting means for transmitting a communication connection establishment request and a receiver having a receiving means for receiving the communication connection establishment request, wherein the coordinate position does not change due to facial expressions such as emotion, emotion, and so on. Using the portrait image data including the invariant face part coordinate sequence that is the coordinate sequence of the face part, and the deformed face part coordinate sequence that is the coordinate sequence of the face part whose coordinate position changes according to expressions such as emotions,
A portrait communication device for displaying a facial expression with a facial expression corresponding to a facial expression specified by a sender on a receiver, wherein the transmitter has a user identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver. Input interface means capable of inputting from the user, sender ID storage means for storing sender ID, and receiver ID from the input interface means
And the expression specifying parameter, and transmission control means for passing the sender identification ID from the sender identification ID storage means to the transmission means, wherein the transmission means includes the sender identification ID and the A facial expression designation parameter is transmitted to the receiver specified by the receiver identification ID together with the communication connection establishment request, and the receiving means of the receiver transmits the sender identification ID together with the communication connection establishment request from the transmitter. Receiving the facial expression specifying parameter, the receiver; receiving control means for separating the received sender ID and the facial expression specifying parameter; a sender ID and a portrait of the sender corresponding to the transmitter ID A portrait data storage unit in which a data pair is stored; a facial expression specifying parameter; and a deformed face corresponding to the facial expression specifying parameter. A transformation rule storage means for storing a pair of transformation amounts of a product coordinate sequence; and the expression specifying parameter from the reception control unit stored in the transformation rule storage means for obtaining a post-transformation transformation face part coordinate sequence. Expression transformation means for transforming the transformed face part coordinate sequence extracted from the portrait data storage means with a transformation amount corresponding to the above, and a drawing rule for drawing a face part from the transformed face part coordinate sequence and the invariant face part coordinate sequence are stored. A drawing rule storage unit, and a drawing for drawing a facial expression with a facial expression by applying the drawing rule to the post-deformation deformed face part coordinate sequence from the facial expression deformation unit and the invariant face part coordinate sequence from the portrait data storage unit. A portrait communication device, further comprising: means for displaying a portrait with a facial expression drawn by the drawing means. 7. The ring tone connected to the reception control means, receiving the facial expression designation parameter received from the transmitter from the reception control means, and controlling a ring tone according to the facial expression designation parameter. The caricature apparatus according to claim 6, further comprising control means. 8. The receiver is connected to the reception control means, receives the expression specifying parameter received from the transmitter from the reception control means, and receives the communication from the transmitter according to the expression specification parameter. 7. The portrait apparatus according to claim 6, further comprising a response setting control unit that determines a response to the connection establishment request. 9. An invariant face part coordinate sequence that is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and sorrows, and a coordinate sequence of a face part whose coordinate position changes according to expressions such as emotions and sorrows. A transmission means for transmitting a communication connection establishment request in a portrait communication system in which a portrait with facial expressions corresponding to a facial expression specified on the transmitter side is displayed on the receiver side, using portrait data including a certain deformed face part coordinate sequence. Input interface means for allowing a user to input a facial expression designation parameter indicating a recipient identification ID and a facial expression to be displayed on the receiver; and a facial expression designation parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression designation parameter. A transformation rule storage unit in which a pair is stored; a sender identification ID storage unit in which a sender identification ID is stored; The transformation amount corresponding to the facial expression specification parameter input from is retrieved from the transformation rule storage means, and the receiver identification ID from the input interface means, the sender identification ID from the sender identification ID storage means, and the transformation Transmission control means for passing the deformation amount from the rule storage unit to the transmission means, wherein the transmission means transmits the sender identification ID and the deformation amount together with the communication connection establishment request to the receiver identification I.
A transmitter for transmitting to the receiver designated by D. 10. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, receiving means for receiving a sender connection ID and a deformation amount of a deformed face part coordinate sequence corresponding to the specified expression together with a communication connection establishment request from the transmitter; Reception control means for separating the ID and the amount of deformation; portrait data storage means for storing a pair of the sender ID and the portrait data of the sender corresponding to the sender ID; An expression deforming means for deforming the deformed face part coordinate sequence extracted from the portrait data storage means by the deformation amount from the reception control unit to obtain a sequence; A drawing rule storage unit in which a drawing rule for drawing a face part from the coordinate sequence and the invariant face part coordinate sequence is stored; A receiver comprising: drawing means for drawing a facial expression with a facial expression by applying the drawing rule to a face part coordinate sequence; and display means for displaying a facial portrait with a facial expression drawn by the drawing means. 11. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, transmitting means for transmitting a communication connection establishment request, input interface means capable of inputting from a user a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver, A transformation rule storage unit in which a pair of a facial expression designating parameter and a transformation amount of a deformed face part coordinate sequence corresponding to the facial expression designation parameter is stored; a sender identification ID storage unit in which a sender identification ID is stored; Self-portrait data storage means for storing portrait data of a person; and facial expression designation parameters input from the input interface means. Is obtained by obtaining the deformation amount corresponding to the above from the deformation rule storage means, and obtaining the deformed face part coordinate sequence after deformation, by transforming the deformed face part coordinate sequence extracted from the self portrait data storage means with the obtained deformation amount. Deforming means; and said receiver identification I from said input interface means.
D, transmission control means for transmitting the sender identification ID from the sender identification ID storage means and the post-transformation deformed face part coordinate sequence from the facial expression transformation means to the transmission means, wherein the transmission means A transmitter that transmits the sender identification ID and the deformed face part coordinate sequence together with the communication connection establishment request to a receiver specified by the receiver identification ID. 12. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and sorrows,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a deformed face part coordinate sequence after deformation of a deformed face part coordinate string deformed according to a sender identification ID and a designated expression is received from a transmitter together with a communication connection establishment request. Receiving means; receiving control means for separating the received sender identification ID and the transformed deformed face part coordinate sequence; storing a pair of the sender identification ID and the portrait image data of the sender corresponding to the sender identification ID A drawing data storing means, a drawing rule storing means for storing a drawing rule for drawing a face part from a deformed face part coordinate sequence and an invariant face part coordinate sequence, Drawing means for drawing the facial expression with a facial expression by applying the drawing rule to the post-deformation deformed face part coordinate sequence from the control means and the invariant face part coordinate sequence from the portrait data storage means; Display means for displaying a portrait with a facial expression. 13. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, transmitting means for transmitting a communication connection establishment request, and input interface means for allowing a user to input a recipient identification ID and a facial expression specifying parameter indicating a facial expression to be displayed on the receiver. A sender identification ID storing means in which a sender identification ID is stored; and the receiver identification ID from the input interface means.
And transmission control means for passing the sender identification ID from the sender identification ID storage means to the transmission means, wherein the transmission means includes the sender identification ID and the expression. A transmitter that transmits the designated parameter together with the communication connection establishment request to the receiver specified by the receiver identification ID. 14. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, receiving means for receiving a sender identification ID and a facial expression designation parameter indicating a designated facial expression together with a communication connection establishment request from a transmitter, the received sender ID and the facial expression Reception control means for separating designated parameters; caricature data storage means for storing a pair of a sender identification ID and caricature data of a sender corresponding to the sender identification ID; and a facial expression designation parameter and a corresponding to the facial expression designation parameter A transformation rule storing means for storing a pair of transformation amounts of the transformed face part coordinate sequence, and obtaining a transformed face part coordinate sequence after transformation. An expression deforming means for deforming a coordinate sequence of a deformed face part extracted from the portrait data storage means with an amount of deformation corresponding to the expression designating parameter from the reception control unit stored in the deformation rule storage means; A drawing rule storage unit in which a drawing rule for drawing a face part from the part coordinate sequence and the invariant face part coordinate sequence is stored; and a post-deformation deformed face part coordinate sequence from the expression deformation unit and the portrait image data storage unit. A receiver comprising: drawing means for applying a drawing rule to an invariant face part coordinate sequence to draw a portrait with expression; and display means for displaying a portrait with expression drawn by the drawing means. 15. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a transmission function of transmitting a communication connection establishment request, an input interface function that allows a user to input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver, A transformation rule storage function in which a pair of a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter is stored; a sender identification ID storage function in which a sender identification ID is stored; The transformation amount corresponding to the expression specifying parameter inputted from the input interface function is taken out from the transformation rule storage function, and A transmission control function of passing the receiver identification ID from the interface function, the sender identification ID from the sender identification ID storage function, and the amount of deformation from the deformation rule storage unit to the transmission function, The transmission function includes the sender identification ID and the deformation amount together with the communication connection establishment request.
A program for causing a computer to realize the function of the transmitter, which is transmitted to the receiver designated by D. 16. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and sorrows,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. A portrait communication system displayed on the receiver side, a receiving function of receiving a communication connection establishment request from a transmitter, a sender identification ID and a deformation amount of a deformed face part coordinate sequence corresponding to the specified expression, A reception control function for separating the identification ID and the amount of deformation, a portrait data storage function for storing a pair of the sender identification ID and the portrait data of the sender corresponding to the sender identification ID, and a deformed face part coordinate after deformation An expression transformation function for transforming the transformed face part coordinate sequence extracted from the portrait data storage function with the transformation amount from the reception control unit to obtain a sequence; A drawing rule storage function in which a drawing rule for drawing a face part from the coordinate sequence and the invariant face part coordinate sequence is stored; and a constant from the post-deformation deformed face part coordinate sequence and the portrait data storage function from the expression deformation function. A computer realizes a function of a receiver having a drawing function of drawing a portrait with a facial expression by applying the drawing rule to a face part coordinate sequence and a display function of displaying a portrait with a facial expression drawn by the drawing function. program. 17. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a transmission function of transmitting a communication connection establishment request, an input interface function that allows a user to input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver, A transformation rule storage function in which a pair of a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter is stored; a sender identification ID storage function in which a sender identification ID is stored; Self-portrait data storage function that stores the portrait data of the other person, and the facial expression specification parameter input from the input interface function. In order to obtain a deformation amount corresponding to the above from the deformation rule storage function and obtain a post-deformation deformation face part coordinate sequence, an expression for deforming the deformation face part coordinate sequence extracted from the self portrait data storage function with the obtained deformation amount A transformation function; and the receiver identification I from the input interface function.
D, a transmission control function of passing the sender identification ID from the sender identification ID storage function and the post-transformation deformed face part coordinate sequence from the expression transformation function to the transmission function, A program for causing a computer to implement the function of a transmitter for transmitting the sender identification ID and the deformed face part coordinate sequence together with the communication connection establishment request to the receiver specified by the receiver identification ID. 18. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a deformed face part coordinate sequence after deformation of a deformed face part coordinate string deformed according to a sender identification ID and a designated expression is received from a transmitter together with a communication connection establishment request. A reception function, a reception control function of separating the received sender identification ID and the transformed deformed face part coordinate sequence, and a pair of the sender identification ID and the portrait image data of the sender corresponding to the sender identification ID are stored. A drawing rule storage function in which a drawing rule for drawing a face part from a deformed face part coordinate sequence and an invariant face part coordinate sequence is stored; A drawing function of applying the drawing rule to the post-deformation deformed face part coordinate sequence from the control function and the invariant face part coordinate sequence from the portrait data storage function to draw a facial expression with a facial expression; A program for causing a computer to realize a function of a receiver further having a display function of displaying a portrait with a facial expression. 19. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a transmission function of transmitting a communication connection establishment request, an input interface function that allows a user to input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver. A sender identification ID storing function in which a sender identification ID is stored; and the receiver identification ID from the input interface function.
And a transmission control function of passing the sender identification ID from the sender identification ID storage function to the transmission function. The transmission function includes the sender identification ID and the expression. A program for causing a computer to realize a function of a transmitter that transmits a designated parameter together with the communication connection establishment request to a receiver specified by the receiver identification ID. 20. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a reception function of receiving a sender identification ID and a facial expression designation parameter indicating a designated facial expression together with a communication connection establishment request from the transmitter, the received sender identification ID and the facial expression A reception control function for separating designated parameters; a portrait data storage function in which a pair of a sender identification ID and a portrait image data of a sender corresponding to the sender identification ID is stored; and a facial expression designation parameter and a corresponding facial expression designation parameter. A transformation rule storage function that stores a pair of transformation amounts of the transformed face part coordinate sequence, and a transformation face part coordinate sequence after transformation An expression transformation function for transforming a coordinate sequence of transformed face parts extracted from the portrait data storage function with a transformation amount corresponding to the expression designating parameter from the reception control unit stored in the transformation rule storage function; A drawing rule storage function in which a drawing rule for drawing a face part from the part coordinate sequence and the invariant face part coordinate sequence is stored; and a post-deformation deformed face part coordinate sequence from the expression deformation function and the portrait data storage function. A function of a receiver having a drawing function of drawing a portrait with expression by applying the drawing rule to the invariant face part coordinate sequence, and a display function of displaying a portrait with expression drawn by the drawing function. The program to be realized. 21. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a transmission function of transmitting a communication connection establishment request, an input interface function that allows a user to input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver, A transformation rule storage function in which a pair of a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter is stored; a sender identification ID storage function in which a sender identification ID is stored; The transformation amount corresponding to the expression specifying parameter inputted from the input interface function is taken out from the transformation rule storage function, and A transmission control function of passing the receiver identification ID from the interface function, the sender identification ID from the sender identification ID storage function, and the amount of deformation from the deformation rule storage unit to the transmission function, The transmission function includes the sender identification ID and the deformation amount together with the communication connection establishment request.
A computer-readable recording medium for recording a program for causing a computer to realize the function of the transmitter, which is transmitted to the receiver designated by D. 22. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to facial expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. A portrait communication system displayed on the receiver side, a receiving function of receiving a communication connection establishment request from a transmitter, a sender identification ID and a deformation amount of a deformed face part coordinate sequence corresponding to the specified expression, A reception control function for separating the identification ID and the amount of deformation, a portrait data storage function for storing a pair of the sender identification ID and the portrait data of the sender corresponding to the sender identification ID, and a deformed face part coordinate after deformation An expression transformation function for transforming the transformed face part coordinate sequence extracted from the portrait data storage function with the transformation amount from the reception control unit to obtain a sequence; A drawing rule storage function in which a drawing rule for drawing a face part from the coordinate sequence and the invariant face part coordinate sequence is stored; and a constant from the post-deformation deformed face part coordinate sequence and the portrait data storage function from the expression deformation function. A computer realizes a function of a receiver having a drawing function of drawing a portrait with a facial expression by applying the drawing rule to a face part coordinate sequence and a display function of displaying a portrait with a facial expression drawn by the drawing function. A computer-readable recording medium on which a program is recorded. 23. An invariant face part coordinate sequence which is a coordinate sequence of a face part whose coordinate position does not change due to an expression such as emotion, emotion and so on.
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a transmission function of transmitting a communication connection establishment request, an input interface function that allows a user to input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver, A transformation rule storage function in which a pair of a facial expression specifying parameter and a deformation amount of a deformed face part coordinate sequence corresponding to the facial expression specifying parameter is stored; a sender identification ID storage function in which a sender identification ID is stored; Self-portrait data storage function that stores the portrait data of the other person, and the facial expression specification parameter input from the input interface function. In order to obtain a deformation amount corresponding to the above from the deformation rule storage function and obtain a post-deformation deformation face part coordinate sequence, an expression for deforming the deformation face part coordinate sequence extracted from the self portrait data storage function with the obtained deformation amount A transformation function; and the receiver identification I from the input interface function.
D, a transmission control function of passing the sender identification ID from the sender identification ID storage function and the post-transformation deformed face part coordinate sequence from the expression transformation function to the transmission function, A program for transmitting the transmitter identification ID and the post-deformation deformed face part coordinate sequence to the receiver specified by the receiver identification ID together with the communication connection establishment request. Computer readable recording medium. 24. An invariant face part coordinate sequence which is a coordinate sequence of a face part whose coordinate position does not change due to an expression such as emotion, emotion and so on.
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a deformed face part coordinate sequence after deformation of a deformed face part coordinate string deformed according to a sender identification ID and a designated expression is received from a transmitter together with a communication connection establishment request. A reception function, a reception control function of separating the received sender identification ID and the transformed deformed face part coordinate sequence, and a pair of the sender identification ID and the portrait image data of the sender corresponding to the sender identification ID are stored. A drawing rule storage function in which a drawing rule for drawing a face part from a deformed face part coordinate sequence and an invariant face part coordinate sequence is stored; A drawing function of applying the drawing rule to the post-deformation deformed face part coordinate sequence from the control function and the invariant face part coordinate sequence from the portrait data storage function to draw a facial expression with a facial expression; A computer-readable storage medium storing a program for causing a computer to realize a function of a receiver further having a display function of displaying a portrait with a facial expression. 25. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a transmission function of transmitting a communication connection establishment request, an input interface function that allows a user to input a recipient identification ID and a facial expression designation parameter indicating a facial expression to be displayed on the receiver. A sender identification ID storing function in which a sender identification ID is stored; and the receiver identification ID from the input interface function.
And a transmission control function of passing the sender identification ID from the sender identification ID storage function to the transmission function. The transmission function includes the sender identification ID and the expression. A computer-readable recording medium that records a program for causing a computer to realize a function of a transmitter, which transmits the designated parameter to the receiver specified by the receiver identification ID together with the communication connection establishment request. 26. An invariant face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position does not change due to expressions such as emotions and emotions,
And, using portrait data including a deformed face part coordinate sequence, which is a coordinate sequence of a face part whose coordinate position changes depending on facial expressions such as emotions and emotions, a facial expression with a facial expression corresponding to the facial expression specified on the transmitter side is generated. In the portrait communication system displayed on the receiver side, a reception function of receiving a sender identification ID and a facial expression designation parameter indicating a designated facial expression together with a communication connection establishment request from the transmitter, the received sender identification ID and the facial expression A reception control function for separating designated parameters; a portrait data storage function in which a pair of a sender identification ID and a portrait image data of a sender corresponding to the sender identification ID is stored; and a facial expression designation parameter and a corresponding facial expression designation parameter. A transformation rule storage function that stores a pair of transformation amounts of the transformed face part coordinate sequence, and a transformation face part coordinate sequence after transformation An expression transformation function for transforming a coordinate sequence of transformed face parts extracted from the portrait data storage function with a transformation amount corresponding to the expression designating parameter from the reception control unit stored in the transformation rule storage function; A drawing rule storage function in which a drawing rule for drawing a face part from the part coordinate sequence and the invariant face part coordinate sequence is stored; and a post-deformation deformed face part coordinate sequence from the expression deformation function and the portrait data storage function. A function of a receiver having a drawing function of drawing a portrait with expression by applying the drawing rule to the invariant face part coordinate sequence, and a display function of displaying a portrait with expression drawn by the drawing function. A computer-readable recording medium recording a program to be realized.