JP3636041B2 - Pronunciation control system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a pronunciation control system for playing music, particularly ensemble performance.
[0002]
[Prior art]
The most popular performance device used for playing electronic musical instruments is a keyboard. The keyboard has 5-6 octave keys, the pitch and tone can be selected depending on which key is pressed, and the strength of the sound can be controlled by the strength of the key pressed. Performance is possible, but skill is required for performance, and it takes time to master.
[0003]
Some electronic musical instruments have an automatic performance function that performs automatic performance by reading out automatic performance data such as MIDI sequence data in accordance with the tempo clock and inputting the data to a sound source. If a start operation such as pressing is performed, the music is automatically played, and there is no room for the user to operate thereafter, and the user cannot participate in the performance or control the performance.
[0004]
[Problems to be solved by the invention]
In this way, when playing music using an electronic musical instrument, it is not easy because it requires skill to operate the keyboard and playing it yourself. However, it was difficult for the user to participate in the performance, and it was difficult for the user to participate in the performance. In particular, in the case of an ensemble in which a plurality of performers perform together, there is a problem that a good performance cannot be performed unless the skills of the respective performers are complete.
[0005]
An object of the present invention is to provide a pronunciation control system that can participate in the performance of music by an easy operation and can lower the threshold of the performance of music.
[0006]
[Means for Solving the Problems]
  The invention of claim 1A sound generation control system comprising a plurality of operation units operated by different users, and a control device for automatically playing music of a plurality of parts,
  Each operation unitSensor means for detecting the movement mode or posture state of the user's body, and the detected content of the sensor means as operation datawirelessWith transmission means to send,With,
  The control device assigns each operation unit to a separate part, receiving means for receiving operation data from the plurality of operation units,Based on the operation data received from the operation unitAt least the tempo or volume of the part assigned to each operation unitPerformance control means to control and,It is provided with.
[0007]
The operation unit detects the movement mode or posture state of each part of the body. The body part to be detected may be anywhere such as an arm, a leg, or a finger. When detecting the motion mode, motion such as rocking and bending / extending of the body part as the detection target is detected. The motion mode to be detected is not limited to bending and stretching and swinging, and any motion mode may be used. This movement is detected by sensor means attached to the body part or sensor means operated on the body part such as a hand. As the sensor means, a sensor means such as a key switch or an impact pad that makes contact with a predetermined part of the body by physical movement may be used. Preferably, the sensor means attached to the predetermined part of the body or a hand is used. Sensor means that move with the body by being operated on the body part are preferred. As such a sensor means, an acceleration sensor, a speed sensor, an impact sensor or the like can be used.
[0008]
In addition, the posture state refers to a static state such as which direction the body part is facing or the angle at which the joint is bent. When detecting this posture mode, the sensor means attached to the body part Or a sensor means operated on a body part such as a hand. As this sensor means, a gyro sensor, an angle sensor, or the like can be used.
[0009]
In the automatic performance of music, a predetermined tone color, pitch, and volume are sounded at a predetermined timing for a predetermined tone length, and the musical sound is continuously generated at a predetermined tempo. In the present invention (automatic performance control mode), at least one of performance elements such as the timbre, pitch (pitch), sound quality, volume, timing, tone length, tempo and the like is controlled based on the operation data. For example, the pitch and pitch (type of note) of a musical tone to be generated are those of automatic performance data, the performance tempo is determined based on the movement mode such as rocking or tapping, and the volume is rocked or tapped. The control method is based on the size of the sound, the pitch of the musical tone to be generated is that of automatic performance data, and the sound generation timing is set to the local peak of the operation data. Further, the basic pitch may be that of automatic performance data, and the fine pitch fluctuation may be controlled by the operation data. In any case, by reading some performance elements from the automatic performance data and releasing the remaining part of the performance elements to the user (operation unit), the user can move the performance elements to the operation unit. It is possible to participate in the performance by controlling via the control, and to lower the threshold of the performance of music.
[0010]
In the present invention, a plurality of operation units respectively transmit operation data to a control device that performs automatic performance. The plurality of operation units output different operation data according to the operation of the user who operates the operation unit. When automatic performance data consists of multiple parts, assigning each operation unit to a different part allows some performance elements of each part to be controlled by different operation units. Participants can participate and perform performances including ensemble elements with easy operation.
[0013]
  Claim2The invention of claim1In the present invention, based on the operation data,At least the tempo or volume of each partAnd a recording means for recording the automatic performance data controlled.
  Claim3According to the present invention, in the above invention, the performance control means automatically plays a music piece based on the automatic performance data recorded by the recording means.
[0014]
  The automatic performance data in which some performance elements are controlled by the operation unit is output to the sound source device, and the sound source device generates a musical sound. In the present invention, the automatic performance data in which some of the performance elements are controlled is recorded and stored as the automatic performance data corrected by the user. And further claims3In this invention, the performance control means reads the automatic performance data corrected by the user as automatic performance data in which some performance elements are controlled again by the operation unit. Accordingly, it is possible to control performance elements for each part by one automatic performance and to control performance elements for all parts by multiple automatic performances. It is also possible to control some performance elements by one automatic performance and to control a plurality of desired performance elements by a plurality of performances.
[0016]
  Claim4The invention ofA sound generation control system comprising a plurality of operation units operated by a plurality of users and a control device including a sound source device that generates a plurality of musical tones at pitches,
  Each operation unitSensor means for detecting the movement mode or posture state of the user's body, and the detected content of the sensor means as operation datawirelessWith transmission means to send,With,
  The control device includes receiving means for receiving operation data from the plurality of operation units;Different pitches for each operation unitAssign toBased on the operation data received from each operation unitAssigned to each operation unit.Pronunciation of musical tonesAnd mute timingPronunciation control means to control,It is provided with.
  Claim5In the above invention, in the above invention, the sound generation control means reads out automatic performance data including a pitch and a sound generation timing of each note of the music at a predetermined tempo, and performs performance guide information for instructing a pitch and a sound generation timing of each note. It is characterized by generating.
[0017]
In the present invention, musical sounds having different pitches are assigned to the respective operation units. For example, when swinging of each operation unit is detected, control is performed such as sounding a musical tone with a comparable pitch. When each operation unit is operated by a different user, it is possible to perform a performance like a so-called hand bell in which each user plays a song in charge of one or several different bells.
In this case, the control device reads the song data of the song to be played and generates operation guide information for the operation unit corresponding to the pitch to be sounded, so that each user can respond accordingly. The music can be easily played by operating the operation unit.
In the case of a hand bell, one person may be in charge of two or three bells. In the present invention, one person can operate one operation unit by assigning a plurality of pitches to one operation unit. Even if he / she has a song, it is possible to have a performance form similar to one person in charge of a plurality of bells. In this case, the musical tone of which pitch is to be generated among the pitches assigned in response to the operation of the operation unit is determined by monitoring the progress of the song with the song data and this time depending on the operation of the operation unit. What is necessary is just to determine whether a pitch should be pronounced.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
A sound generation control system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a schematic configuration of the entire sound generation control system. The sound generation control system includes a plurality of hand controllers 1 that are operation units, a communication unit 2, a performance control device 3 including a personal computer, a sound source device 4, an amplifier 5, and a speaker 6. Separate ID numbers (= 1 to 24) are set for the plurality of hand controllers 1. The hand controller 1 has a baton shape and is swung by a user. The built-in acceleration sensor 17 (see FIG. 2) detects the acceleration caused by the swing operation. The detected acceleration is wirelessly transmitted from the hand controller 1 to the communication unit 2 as operation data. The communication unit 2 receives operation data wirelessly transmitted from the plurality of hand controllers 1 and transfers it to the performance control device 3. The performance control device 3 analyzes the input operation data and controls the tone generation by the sound source device 4. The tone generator 4 has a function of forming a musical sound waveform and applying an effect to the formed musical sound waveform, and the sound generation control by the performance control device 3 controls the formation of the musical sound waveform and the formed musical sound waveform. Includes both control of the effect applied.
[0020]
The basic usage form of the plurality of hand controllers 1 is that each user controller 1 is operated by a separate user to perform performance control. The performance control device 3 that is a control device automatically plays a multi-part song based on the song data. Each part of the plurality of parts is assigned to a separate hand controller 1, and performance is controlled by a swing operation of each hand controller 1. The performance control includes, for example, controlling the performance tempo based on the swing tempo (the interval at which the swing peak is detected), and controlling the volume based on the swing acceleration (or speed). Thus, by controlling each part by a separate user (hand controller 1), it is possible to make the user enjoy a simple ensemble performance. It is also possible to assign different pitches to each hand controller and perform an ensemble like a so-called hand bell. In this case, when a hand controller 1 is swung, a musical tone having a pitch assigned to the hand controller 1 is generated with a volume corresponding to the magnitude of the swing acceleration. The music progresses when each user swings the hand controller 1 at the timing of the pitch (note) that he / she is in charge of according to the music.
[0021]
In FIG. 2, the hand controller 1 has a baton shape with a thin central portion, and the housing can be separated into an upper housing 10 and a lower housing 11 with the thinnest center as a boundary. it can. A cord-shaped antenna 18 is pulled out from the bottom of the lower housing 11. Inside, there is provided a circuit board 13 on which a receiving circuit, a CPU, a switch group and the like which will be described later are mounted.
[0022]
On the side of the upper housing 10 of the circuit board 13, four-color LEDs 14 (14 a to 14 d), a switch group 15 (15 a to 15 d), a 2-digit 7-segment display 16, a triaxial acceleration sensor 17, and the like are mounted. ing. The LEDs 14a, 14b, 14c, and 14d are LEDs that emit blue light, green light, red light, and orange light, respectively. When the upper housing 10 is removed from the lower housing 11, the upper side of the circuit board 13 is exposed and the switch group 15 can be operated. The switch 15a is a power switch, the switch 15b is a single tone sounding mode selection switch, 15c is an automatic performance control mode selection switch, and 15d is an ENTER switch. When the mode is selected by the switches 15b and 15c and the ENTER switch 15d is turned on, the selected mode is transmitted as mode selection data. However, only the mode selection data transmitted by the hand controller with ID number = 1 is input to the performance control device 3.
[0023]
Among the modes selected by the mode selection switch, the single tone sound generation mode is a mode in which a predetermined musical sound is generated at a local peak point of acceleration caused by the swing operation of the hand controller 1, and different sounds are generated by the plurality of hand controllers 1. This mode assigns high musical tones and plays an ensemble like a hand bell.
The automatic performance control mode refers to the tempo and volume of the automatic performance processing operation in which the performance control device 3 sequentially outputs the automatic performance data stored in the storage device to the sound source device 4 by the swing operation of the hand controller 1. In this mode, each part of music data composed of a plurality of parts is controlled separately by a plurality of hand controllers 1. In this embodiment, the automatic performance tempo is controlled by the interval (cycle) of the local peak of the swing operation of the hand controller 1, and the volume and sound quality of the automatic performance are controlled by the speed and magnitude of the swing.
[0024]
FIG. 3 is a block diagram of the control unit of the hand controller 1. The control unit 20 is composed of a microcomputer in which a CPU, a memory, an interface, and the like are built in one chip, and controls the operation of the hand controller 1. The control unit 20 is connected to a triaxial acceleration sensor 17, a switch group 15, an ID setting switch 21, a modem 23, a modulation circuit 24, a demodulation circuit 27, an LED display circuit 22, and the like.
[0025]
The acceleration sensor 17 is a semiconductor sensor that can respond to a sampling frequency of about 400 Hz and has a resolution of about 8 bits. When the acceleration sensor 17 swings due to the swing of the hand controller 1, 8-bit acceleration data is output for each of the X-axis direction, the Y-axis direction, and the Z-axis direction. The acceleration sensor 17 is built in the tip of the hand controller 1 so that the X axis, Y axis, and Z axis are in the directions shown in FIG. The acceleration sensor 17 is not limited to a three-axis sensor, and may be a two-axis sensor or a non-directional sensor.
[0026]
The ID setting switch 21 is a 5-bit dip switch and can set ID numbers 1 to 24. The ID setting switch 21 is mounted on the circuit board 13 on the lower housing 11 side, and is operated by extracting the circuit board 13 from the lower housing 11.
[0027]
The control unit 20 outputs the acceleration data input from the acceleration sensor 17 to the modem 23 as operation data. An ID number set by the ID setting switch 21 is added to the operation data. The mode selected by the mode selection switches 15b and 15c is output to the modem 23 as mode selection data different from the operation data.
[0028]
The modem 23 is a circuit that converts baseband data input from the control unit 20 into phase transition data. The modulation circuit 24 is a circuit that enables GMSK modulation of a carrier signal in the 2.4 GHz band with the phase transition data to enable wireless transmission. The 2.4 GHz band signal output from the modulation circuit 24 is amplified to about weak power by the transmission output amplifier 25 and is copied and output from the antenna 18. The antenna 18 has an isolator, and is connected to the receiving circuit 26 in addition to the transmission output amplifier 25 via the isolator. The receiving circuit 26 is a circuit that receives and amplifies a 2.4 GHz band signal incident on the antenna 18, and the demodulating circuit 27 and the modem 23 convert the GMDK-modulated data contained in the received signal into baseband data. Demodulated and input to the control unit 20. The control unit 20 takes in the data assigned with its own ID as data destined for the own station.
[0029]
The hand controller 1 is configured to communicate with the communication unit 2 wirelessly as described above, but may be configured to perform wired communication via a USB interface or the like. Further, a short-range wireless interface using a frequency spreading method such as Bluetooth can be applied.
[0030]
FIG. 6 is a diagram showing a format of data transmitted from the hand controller 1 to the communication unit 2. FIG. 4A is a diagram showing the configuration of operation data. The operation data includes the controller ID number (5 bits), a code indicating operation data (3 bits), X-axis direction acceleration data (8 bits), Y-axis direction acceleration data (8 bits), and Z-axis direction acceleration. It consists of data (8 bits). FIG. 4B shows the configuration of mode selection data. The mode selection data consists of a controller ID number (5 bits), a code (3 bits) indicating that there is mode selection data, and a mode number (8 bits).
[0031]
FIG. 4 is a block diagram of the communication unit 2. The communication unit 2 is a device that receives data (operation data, mode selection data) transmitted by the hand controller 1 and transfers the data to the performance control device 3 that is a personal computer. The communication unit 2 includes a main control unit 30, a plurality of individual communication units 31, and a USB interface 39. A plurality of individual communication units 31 are set with different ID numbers, and communicate with the hand controller 1 having a corresponding ID number.
[0032]
In FIG. 2A, an individual communication unit 31 and a USB interface 39 are connected to a main control unit 30 composed of a microprocessor. A USB interface 46 (see FIG. 5) of the performance control device 3 is connected to the USB interface 39.
[0033]
The configuration of the individual communication unit 31 is shown in FIG. An ID switch 38, a demodulation circuit 35, and a modulation circuit 36 are connected to the individual control unit 33 configured by a microprocessor. The ID switch 38 is constituted by a dip switch, and the same ID number as that of the corresponding hand controller 1 is set. A reception circuit 34 is connected to the demodulation circuit 35, and the reception circuit 34 selectively receives a 2.4 GHz band signal input from the antenna 32, and a GMSK modulation signal transmitted from the hand controller 1 from the signal. Is a circuit for detecting and outputting the signal. The demodulation circuit 35 demodulates the data (operation data, mode selection data) of the hand controller 1 from this GMSK modulation signal. The individual control unit 33 reads the ID number attached to the head of the demodulated data and determines whether this ID number is the same as the ID number set by the ID switch 38. If they are the same, the data is taken as data for the individual communication unit 31 and input to the main control unit 30.
[0034]
A transmission circuit 37 is connected to the modulation circuit 36, and the transmission circuit 37 is connected to the antenna 32. The modulation circuit 36 performs GMSK modulation on the data output from the individual control unit 33 in the same manner as the modem 23 described above. The transmission circuit 37 performs GMSK modulation on a carrier in the 2.4 GHz band with the GMSK modulated signal and outputs the result from the antenna 32. When there is data (performance guide information) to be transmitted to the corresponding hand controller 1, the data is transmitted to the hand controller 1 via the modulation circuit 35 and the transmission circuit 37.
[0035]
The data to be transmitted is transmitted immediately after receiving data from the corresponding hand controller 1. By performing at this timing, transmission and reception do not collide in the hand controller 1.
[0036]
FIG. 5 is a block diagram of the performance control device 3 which is a control device. The CPU 41 that controls the entire apparatus is connected to a ROM 42, a RAM 43, a mass storage device 44, a MIDI interface 45, a USB interface 46, a keyboard 47, a pointing device 48, a display unit 49, and a communication interface 50 via a bus. Yes. The MIDI interface 45 is connected to a sound source device 51 that is an external device.
[0037]
The ROM 42 stores a startup program and the like. The large-capacity storage device 44 includes a hard disk, CD-ROM, MO, and the like, and stores system programs, application programs, song data, and the like. A system program, an application program, and the like are read into the RAM 43 from the mass storage device 44 when the performance control device 3 is started or after it is started. The RAM 43 has a storage area necessary for executing the application program. A USB interface 39 of the communication unit 2 is connected to the USB interface 46. The keyboard 47 and the pointing device 48 are used when a user operates an application program, such as selecting a song to be played. Alternatively, this apparatus may be connected to a server apparatus (not shown) via the Internet or a subscriber telephone line using the communication interface 50, and music data may be downloaded from this server apparatus. The downloaded song data is stored in the RAM 43 or the mass storage device 44.
[0038]
The sound source device 4 connected to the MIDI interface 45 generates a musical sound based on performance data (MIDI data) input from the performance control device 3 and gives an effect such as an echo to the generated musical sound. This musical sound is output to the amplifier 5. The amplifier 5 amplifies this musical sound and outputs it to the speaker 6. The speaker 6 emits this musical sound as sound. The sound source device 4 may form a musical sound waveform by any method, and may select a method according to the type of sound such as a continuous sound or an attenuation sound.
[0039]
FIG. 7 is a diagram showing the composition of song data stored in the mass storage device 44 of the performance control device 3.
[0040]
FIG. 4A is a diagram showing the structure of song data for playing a multi-part song. It has a plurality of performance data tracks corresponding to a plurality of parts. In the performance data track of each part, event data in which the pitch or volume of a musical tone to be generated is written and timing data instructing the read timing of the event data are written in time series. In the automatic performance control mode, each track (each part) is assigned to a different hand controller. In addition to the track of each part, it has a control track in which data for designating the tempo is recorded. This track is ignored when each part is played at the tempo specified by the hand controller in the automatic performance control mode.
[0041]
FIG. 5B is a diagram showing the structure of song data dedicated to the single tone sound generation mode. This data consists of a performance track for handbells, an accompaniment track, and a control track. The performance track is a track in which musical sounds to be generated by the operation of a plurality of hand controllers 1 to which different pitches are assigned are written, and the event data of this track is used only for performance guides and actually It is not used for pronunciation. Note that the performance data written to the performance track may not be a single tone string, but may be a multiple tone string in which a plurality of musical sounds are simultaneously generated. The accompaniment track is a normal automatic performance track, and event data of this track is transmitted to the sound source device 4. The control track is a track in which tempo setting data and the like are written, and the song data is played at this tempo.
[0042]
Each track may correspond to a different MIDI channel if the tone is different.
Alternatively, the music data shown in FIG. 6A may be selected in the single tone sound generation mode, and one of a plurality of parts may be used as a handbell track, and another part may be used as an accompaniment track for automatic performance.
[0043]
The operation of the sound generation control system will be described below with reference to the flowchart. FIG. 8 is a flowchart showing the operation of the hand controller 1. When the power switch 15a is turned on, a reset operation such as chip reset is first executed (s1). Next, the ID number is read into the memory (s2). The ID number is set in the ID number setting switch 21 which is a dip switch. The read ID number is displayed on the 7-segment display 16 for a predetermined time (s3).
[0044]
Next, selection of an operation mode is accepted (s4). When the single tone generation mode selection switch 15b is turned on, the single tone generation mode is selected, and when the automatic performance control mode selection switch 15c is turned on, the automatic performance control mode is selected. Next, when the ENTER switch 15d is turned on, the mode selected at that time is set, this is edited into mode selection data and transmitted to the communication unit 2 (s5), and the set mode is displayed in 7 segments. It is displayed on the device 16 (s6). This completes the initial setting operation and shifts to a swing detection operation.
[0045]
The following swing detection operation is executed every 2.5 ms. The three-axis acceleration of the X-axis direction acceleration, the Y-axis direction acceleration, and the Z-axis direction acceleration is detected from the three-axis acceleration sensor 17 (s7), and this is edited into the operation data of FIG. 2 (s9). And lighting control of LED14a-14d is controlled (s10).
[0046]
The mode of lighting control of the LEDs 14a to 14d is as follows. When the acceleration in the + direction in the X-axis direction is equal to or greater than a certain value, the blue light emitting LED 14a is turned on. When the acceleration in the negative direction along the X axis is equal to or greater than a certain level, the green LED 14b is turned on. When the acceleration in the + direction in the Y-axis direction is greater than or equal to a certain level, the red LED 14c is turned on. When the negative acceleration in the Y-axis direction is equal to or greater than a certain value, the orange light emitting LED 14d is turned on. Further, when the acceleration in the + direction in the Z-axis direction is greater than or equal to a certain value, the LED 14a and the LED 14b are turned on simultaneously. When the acceleration in the negative direction in the Z-axis direction is equal to or greater than a certain value, the LED 14c and the LED 14d are turned on simultaneously.
In the lighting control described above, the LEDs 14a to 14d may be turned on with a light amount corresponding to the magnitude of the swing acceleration.
[0047]
The above operation is executed every 2.5 ms, and the X-axis, Y-axis, and Z-axis accelerations are detected with a resolution of about 2.5 ms, so that the user can perform a swinging operation while removing fine vibration noise. It can be detected with high resolution.
[0048]
FIG. 9 is a flowchart showing the operation of the communication unit 2 that receives operation data and mode selection data from the hand controller 1. The communication unit 2 receives data from the hand controller 1 and communicates with the performance control device 3 via the USB interface 39.
[0049]
FIG. 4A is a flowchart showing the operation of the individual communication unit 31 (individual control unit 33). The individual communication unit 31 constantly monitors the frequency assigned to the ID set by the ID switch 38 in the 2.4 GHz band, decodes the signal of this frequency among the received signals, Reading the ID at the top. If the ID matches the ID set in the own device (s11), the data is fetched (s12). Then, this data is input to the main control unit 30 (s13).
[0050]
FIG. 5B is a flowchart showing the operation of the main control unit 30. When data received from the connected individual communication unit 31 is input (s20), it is determined whether the data is operation data or mode selection data (s21). In the case of mode selection data, only one individual communication unit 31 is connected, and when it is input from the individual communication unit 31, as it is, a plurality of individual communication units 31 are currently connected. If the ID is attached to the input mode selection data is 1 (s22), this data is output to the performance controller 3 (s23).
[0051]
On the other hand, if the input data is operation data (s21), it is determined whether the operation data of all IDs (individual communication units) have been prepared (s24). That is, as shown in FIG. 4, a plurality of individual communication units 31 are connected to the main control unit 30, so that each individual communication unit receives different IDs received from the hand controller 1 for the performance control device 3. Is edited into one packet, and this is input to the performance control device 3. When operation data is input from all of the connected individual communication units 31, it is edited into a packet (s25) and input to the performance control device 3 (s26). Since the individual communication unit 31 receives the operation data from the corresponding hand controller 1 every 2.5 ms, the operation data of all IDs are input within a maximum time of 2.5 ms, and the operations of s25 and s26 are also performed for 2.5 ms. It is executed every time.
[0052]
10 to 14 are flowcharts showing the operation of the performance control device 3.
FIG. 10 is a flowchart showing the mode setting operation. When mode selection data is input from the hand controller 1 via the communication unit 2 (s30), it is determined whether the mode selection data is data for selecting the automatic performance control mode or data for selecting the single tone sound generation mode. (S31). In the case of data for selecting the automatic performance control mode, first, music data as shown in FIG. 7A capable of automatic performance control of a plurality of parts is selected (s32). The music data is read into the RAM 43 (s33), and an automatic performance is performed at a tempo corresponding to the operation of the hand controller 1 corresponding to each track (part) (s34).
[0053]
On the other hand, in the case of the single tone sound generation mode, each hand controller is in charge of one or a plurality of pitches and accepts selection of music data for performing like a hand bell (s35). In the music selection input, music data having a structure as shown in FIG. 7B is selected from a plurality of music data stored in the large-capacity storage device 44. The music data shown in FIG. Data may be selected, and one or more parts may be selected and input as performance parts for the handbell. The selected music data is read from the mass storage device 44 to the RAM 43 (s36), and all pitches included in the performance part are determined and assigned to each hand controller (s37). This assignment is not limited to one pitch for one hand controller. A plurality of pitches may be assigned to one hand controller.
[0054]
And it waits until there is a start instruction from the pointing device 48, the keyboard 47 or the hand controller 1 of ID = 1 (s38). When there is a start instruction, a metronome sound for one measure is generated to indicate the tempo. After that, the performance track of the music data is read and performance guide information is output to the corresponding hand controller, and a musical tone is generated according to operation data input from the hand controller 1 (communication unit 2) (s40). . When accompaniment is performed using an accompaniment track, automatic performance is executed at the specified tempo. However, execution of accompaniment using this accompaniment track is not essential, and an operation input from the hand controller 1 to the sound source device 4 Only pronunciation based on data may be performed.
[0055]
FIG. 11 is a flowchart showing an operation for processing operation data input from the hand controller 1 via the communication unit 2. This operation is executed for each hand controller (ID), but only one hand controller will be described here. When operation data is input (s50), it is determined whether the current mode is the automatic performance control mode or the single tone sounding mode (s51). In the automatic performance control mode, the swing acceleration is detected based on the operation data (s52). The swing acceleration is an acceleration vector obtained by combining the X-axis direction acceleration and the Y-axis direction acceleration, or the X-axis direction acceleration, the Y-axis direction acceleration, and the Z-axis direction acceleration. The volume of the corresponding part is controlled according to the magnitude of this vector (s53). Then, it is detected whether or not it is a local peak based on the change in the magnitude and direction of this vector (s54). If no local peak is detected, the process returns from s55 to s50. When a local peak is detected (s55), the tempo of oscillation is determined according to the interval with the previous (or several past) local peak (s56), and the corresponding part (track) is based on this. The tempo of the automatic performance is set (s57). The set tempo is used for reading control of the track data (automatic performance data) of the corresponding part in the automatic performance processing operation described later.
[0056]
On the other hand, when the current mode is the single tone sound generation mode, when the swing data is input (s50), the swing acceleration is calculated based on the swing data (s60). Then, based on this swing acceleration vector, it is detected whether or not it is a local peak (s61). If it is not a local peak, it returns directly from s62. On the other hand, if a local peak is detected, the pitch assigned to the hand controller 1 is read (s63). If a plurality of pitches are assigned, the song data may be read out according to the progress of the song, and it should be determined which tone pitch is to be generated now. Then, sound generation data of this pitch is generated (s64). The sound production data includes volume information determined based on the pitch information and the rocking acceleration. By transmitting this sounding data to the sound source device 4, a musical sound signal is generated.
[0057]
FIG. 12 is a flowchart showing the automatic performance processing operation. In the automatic performance control mode, this operation is executed for each part at a tempo set by the operation of the hand controller, and the read event data (sound generation data) is output to the sound source device 4. In the single tone sound generation mode, this operation is executed at the tempo written in the control unit. The read event data is not output to the sound source device 4.
[0058]
First, the timing data is counted with the set tempo clock (s70), and it is determined whether or not the next event data (sound generation data) has been read (s71). The reading of s70 is continued until the next event data reading timing is reached. However, in the automatic performance control mode, the clock tempo is appropriately changed according to the operation of the hand controller 1. When the next event data read timing is reached, processing corresponding to the event data is executed (s72), the next timing data is read (s73), and the processing returns to s70. The event data (sound generation data) handling process is an operation of outputting the event data to the sound generator device 4 in the automatic performance control mode, and in the case of a performance track in the single sound generation mode, This is an operation of creating and outputting performance guide information for the hand controller corresponding to the pitch. The performance guide information created at this time may be a content (sky telegram) merely informing that it is the pronunciation timing, or may be a content including the volume of the pronunciation data.
[0059]
In the above embodiment, only the tempo control and the volume control are described as the tone control by the hand controller 1, but in addition to this, the sound generation timing control, tone color control, and the like can be performed. The sound generation timing control is, for example, control of detecting a peak point of the swing acceleration and generating a tone at the peak point timing. The tone color control is, for example, a control of changing a musical tone to a soft tone or a hard tone according to a change rate or a change waveform of the swing acceleration.
[0060]
FIG. 13 is a flowchart showing the operations of the communication unit 2 and the hand controller 1 when transmitting performance guide information.
[0061]
FIG. 2A is a flowchart showing the data transfer operation of the main control unit 30 of the communication unit 2. When performance guide information which is data to be transmitted from the performance control device 3 to the hand controller 1 is input (s80), it is transferred to the corresponding individual communication unit 31 (s81).
[0062]
FIG. 5B is a flowchart showing the operation of the individual communication unit 31. This operation is performed in place of the operation of FIG. The individual communication unit 31 constantly monitors the frequency assigned to the ID set by the ID switch 38 in the 2.4 GHz band, decodes the signal of this frequency among the received signals, Reading the ID at the top. If the ID matches the ID set in the own device (s82), the data is fetched (s83). Then, this data is input to the main control unit 30 (s84). Thereafter, it is determined whether or not data (performance guide information) to be transmitted is input from the main control unit 30 (s85). If there is data, it is transmitted to the hand controller 1 (s86). Since data is transmitted at the timing immediately after receiving data from the controller main body 1 in this way, data transmission does not collide even if the hand controller 1 and the communication unit 2 are not synchronized. .
[0063]
FIG. 3C is a flowchart showing the reception operation of the hand controller 1. When FM-modulated performance guide information is sent from the communication unit 2, the FM demodulation circuit 27 and the modem 23 demodulate it and input it to the control unit 20. The controller 20 captures this (s87) and executes a performance guide operation (s88). As the performance guide operation, it is possible to apply an operation of notifying the sound generation timing by causing all the LEDs 14 to emit light, or displaying an instructed volume value on the 7-segment display.
[0064]
In the automatic performance control mode, it is ideal for all parts to play at the same progress, but since the tempo control of each part is left to the user's operation, there is some degree of progress deviation between the parts. Allowed. However, if the progress of performance between parts is too far off, the performance will not be realized, so the performance progress (total clock count from the start of performance) is delayed by a predetermined value or more than the other parts, or a predetermined value. When there is an advanced part that has advanced as described above, advance / delay control may be performed in which performance progress of some parts is stopped or performance is skipped to align the performance.
[0065]
FIG. 14 is a flowchart showing an example of the advance / delay control operation. This operation is executed in parallel with the automatic performance control operation of FIG. First, all clock counts from the start of performance of all parts are compared (s90). As a result of the comparison, when there is a delayed part that is delayed by a predetermined value or more compared to the other parts (s91), the clocks of the other parts are stopped (s92). That is, the operation of s70 in FIG. 12 for the part is stopped. Then, performance guide information indicating that there is a delay with respect to the hand controller 1 of the delayed part is generated and output (s93). On the other hand, as a result of the comparison, if there is an advanced part that is advanced by a predetermined value or more compared to other parts (s94), the clock of this advanced part is stopped (s95). That is, the operation of s70 in FIG. 12 for the part is stopped. Then, performance guide information indicating that the progress is too much for the hand controller 1 of the advance part is generated and output (s96). In this operation, when there is a delayed part, the clock of the other part is stopped, but the performance of the delayed part may be skipped (clock count value is added all at once).
[0066]
In the above embodiment, a plurality of hand controllers (operation units) 1 are in charge of different parts, but one general operation data is generated based on operation data generated by the plurality of hand controllers 1. However, all parts may be controlled uniformly based on the operation data. In that case, a plurality of operation data input as packets from the communication unit 2 are averaged to generate one data, and based on this, the processing operation of FIG. 11 is performed in one system. The process shown in FIG. 12 is performed for all tracks of the song data.
[0067]
Further, instead of averaging the raw operation data, the processing shown in FIG. 11 (excluding the processing of s53 and s57) is performed for each operation data to calculate the swing acceleration and tempo data for each operation hand controller, By averaging the swing acceleration and tempo data, the total swing acceleration and total tempo data can be calculated and used to perform volume control and tempo setting to perform the processing of FIG. Good.
[0068]
In addition, when total data is calculated based on the operation data of the plurality of hand controllers 1 and the music data is collectively controlled, the operation data (or swing acceleration and tempo data) input from the plurality of hand controllers 1 are averaged. In addition to calculating the total data, the operation data with the maximum and minimum values are excluded and the remaining operation data is averaged. The median operation data is extracted. The operation data with the maximum value is extracted. A method such as extracting operation data can be employed.
[0069]
In the automatic performance control mode, one hand controller 1 and one part correspond one-to-one in the above embodiment, but the correspondence is not limited to one-to-one, and one hand controller has a plurality of correspondences. A track may be assigned, or one part may be controlled by a plurality of hand controllers.
[0070]
When one track is controlled by a plurality of hand controllers, comprehensive data for each part is determined based on operation data input from each hand controller, and performance control of that part (track of music data) is performed based on this. To do.
[0071]
In the above embodiment, all the musical sounds of a plurality of parts (plural timbres) are generated by one sound source device 4, but a plurality of sound source devices (instruments) are connected to the performance control device 3 which is a control device. Alternatively, individual sound sources (instruments) may be assigned to each part (all or a part thereof). FIG. 15 shows an example in which a normal sound source device 4, an electronic wind instrument sound source device 60, and an electromagnetically driven piano 61 are connected to the performance control device 3. The sound source device 4 and the electronic wind instrument sound source device 60 are in charge of a plurality of parts, respectively, and the electromagnetically driven piano 61 is in charge of only the piano part. For example, a fundamental wave synthesis type FM sound source or a PCM sound source that synthesizes a musical sound by processing a PCM waveform is applied as the sound source device 4. As the electronic wind instrument sound source device 60, a physical model sound source or the like obtained by simulating an actual wind instrument in software by a processor is used. The electromagnetically driven piano 61 is a piano in which a solenoid is connected to each hammer, and is a natural musical instrument that can drive the solenoid with performance data such as MIDI data. Thus, the sound source that can be connected to the performance control device 3 is not limited to an electronic sound source, and a sound source device that generates an electrically driven natural musical sound can also be connected. In this way, by connecting a plurality of sound sources having different pronunciation forms, an ensemble-like ensemble can be performed both auditorily and visually.
[0072]
Moreover, although the said embodiment uses the hand controller 1 which a user carries with a hand and rocks | fluctuates as an operation unit, an operation unit is not limited to a hand controller. For example, an accelerating sensor may be incorporated in a singing microphone so that singing and automatic performance control can be performed together. If this hand controller built-in microphone is applied to the karaoke apparatus, the singer can control the karaoke song while singing. Further, the operation unit is not limited to one that performs a swing operation, and a tap switch that detects the strength of pressing with a finger may be used. This tap switch can be composed of a piezoelectric sensor or the like.
[0073]
Also, as shown in FIG. 16, a shoe is used as the operation unit 50, and a three-axis acceleration sensor 51 is embedded in the heel to detect a kicking motion that moves the foot back and forth, a swinging motion left and right, and a stepping motion that moves up and down. Based on this, the tone generation of the musical sound may be controlled.
[0074]
In addition, as shown in the upper part of FIG. 17, a fingertip operation unit 52 having a three-axis acceleration sensor 53 is attached to the user's fingertip, and the three-dimensional movement of the finger is detected to control the tone generation. it can. In this case, a different sensor can be controlled for each finger by attaching a separate sensor to each finger.
[0075]
Further, by attaching a wrist operation unit 54 having a three-dimensional acceleration sensor 55 and a pulse sensor 56 to the wrist as shown in the lower part of the figure, the pulse can be detected in addition to the swinging of the arm. In this case, it is possible to control two musical tones with both arms by attaching wrist operation elements to both wrists.
[0076]
In addition, multiple sensors are attached to the user's arms, legs, torso, etc., and multiple operation data corresponding to body movement and posture are output, thereby performing multiple part performance control and multiple pitch sound generation control. It is also possible. 18 and 19 show an embodiment in which an acceleration sensor is provided in each part of the body. FIG. 18 is a diagram showing a user wearing an operation unit. The operation unit has a plurality of sensors 71 embedded in the upper and lower clothes, a control box 70 attached to the belt, and LEDs 72 attached to the upper and lower clothes and the belt. An acceleration sensor, an impact sensor, or the like can be applied as the sensor.
[0077]
Hereinafter, a case where an acceleration sensor is applied as the sensor 71 will be described. The acceleration sensor 71 is provided on the left and right arms, chest, waist, and thighs of the clothes, and detects the manner of swinging of the arms, legs, and upper body. Each acceleration sensor 71 is connected to a control box 70. The control box 70 has a built-in control unit 73, which is a microcomputer, and transmits detection values (acceleration) of the respective acceleration sensors 71 to the communication unit as operation data.
[0078]
FIG. 19A is a block diagram of this operation unit. The control unit 73 is connected to the plurality of acceleration sensors 71, the switch group 74, the transmission unit 75, and the LED lighting circuit 76. The switch group 74 is a switch for setting an operation mode and the like as in the first embodiment. In this operation unit, an ID number is assigned to each of the plurality of acceleration sensors 71 in advance, and the acceleration detected by each acceleration sensor 71 is assigned the ID of each acceleration sensor as shown in FIG. A series of operation data is transmitted to the communication unit 2. The transmission unit 75 includes the modem 23, the modulation circuit 24, the transmission output amplifier 25, and the antenna 18 of FIG. 3, and GMSK-modulates the operation data and transmits it as a 2.4 GHz band signal. The LED lighting circuit 76 controls the lighting of the LEDs provided at various locations on the body (clothes) according to the acceleration detected by each acceleration sensor 71.
[0079]
By providing such an operation unit, one person can control the performance of music of a plurality of parts, or one person can exercise in various ways, and a plurality of musical tones can be generated according to the movement. Will be able to.
[0080]
In the above-described embodiment, an acceleration sensor is used as the sensor 71. However, an impact sensor may be used as the sensor 71. In this case, the operation mode is determined by an operation such as a user hitting or touching the sensor. Can be detected and the tone can be controlled.
[0081]
In the above embodiment, the performance is controlled based on the operation of the user swinging the hand controller 1, but the performance may be controlled based on the static posture of the user.
[0082]
Further, in the case of performing a ensemble in the form of a handbell in the single tone sound generation mode, in the above embodiment, a sound source device is connected to the performance control device 3 to generate a musical sound, but a sound source is built in the operation unit. However, the operation unit itself can also generate music. In this case, only the reception function may be provided in the operation unit 1 and only the transmission function may be provided in the communication unit 2.
[0083]
In the above embodiment, the performance data controlled in the automatic performance control mode is only input to the sound source device 4 and used for sounding. However, the performance data recording means is provided and operated by the operation unit. Performance data may be recorded. Then, the recorded performance data may be read out again as automatic performance data and set as the target of the automatic performance control mode.
[0084]
In this case, automatic performance data of a plurality of parts is automatically played, performance elements of some parts are controlled by one or a plurality of operation units, and these are recorded as automatic performance data. It is possible to automatically perform this again and control the performance elements of the remaining parts.
[0085]
Further, in this case, a part of performance elements such as a tempo is controlled by one automatic performance, another part of performance elements such as a volume is controlled by the next automatic performance, and desired by a plurality of automatic performances. It is also possible to control all the performance elements.
[0086]
【The invention's effect】
As described above, according to the present invention, some performance elements such as the tempo and volume of music performance can be controlled based on the movement modes and posture states of a plurality of users. Performance performance becomes possible and the threshold of music performance can be reduced.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram of a sound generation control system according to an embodiment of the present invention.
FIG. 2 is an external view of a hand controller that is an operation unit of the sound generation control system.
FIG. 3 is a block diagram of a hand controller.
FIG. 4 is a block diagram of a communication unit.
FIG. 5 is a block diagram of a personal computer.
FIG. 6 is a diagram showing a format of data sent from the hand controller to the communication unit
FIG. 7 is a diagram showing the structure of automatic performance data
FIG. 8 is a flowchart showing the operation of the hand controller.
FIG. 9 is a flowchart showing the operation of the communication unit.
FIG. 10 is a flowchart showing the operation of a personal computer.
FIG. 11 is a flowchart showing the operation of a personal computer.
FIG. 12 is a flowchart showing the operation of the personal computer.
FIG. 13 is a flowchart showing a performance guide information transmission / reception operation;
FIG. 14 is a flowchart showing an advance / delay control operation of the personal computer.
FIG. 15 is a diagram showing another embodiment of the sound generation control system according to the embodiment of the present invention.
FIG. 16 is a diagram showing another mode of the operation unit.
FIG. 17 is a diagram showing another aspect of the operation unit.
FIG. 18 is a diagram showing another mode of the operation unit.
FIG. 19 is a block diagram of the operation unit.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Hand controller (operation unit), 2 ... Communication unit, 3 ... Performance control apparatus (personal computer), 4 ... Sound source device, 14a-14d ... LED, 15a-15d ... Switch group, 16 ... 7 segment display device, 17 3 axis acceleration sensor, 22 LED lighting circuit, 23 modem, 24 modulation circuit, 25 transmission output amplifier, 26 reception circuit, 30 main control unit, 31 individual communication unit

Claims (5)

A sound generation control system comprising a plurality of operation units operated by different users, and a control device for automatically playing music of a plurality of parts,
Each operating unit comprises a sensor means for detecting a motion mode or posture of the body of the user, and transmitting means for wirelessly transmitting the detected result of said sensor means as the operation data, and
The control device is configured to receive operation data from the plurality of operation units, assign each operation unit to a separate part, and assign each operation unit based on the operation data received from each operation unit. calling sound control system which includes a performance control means, the control at least tempo or volume of the part. 2. The sound generation control system according to claim 1, further comprising recording means for recording automatic performance data in which at least the tempo or volume of each part is controlled based on the operation data.   3. The sound generation control system according to claim 2, wherein the performance control means automatically plays a music piece based on the automatic performance data recorded by the recording means. A sound generation control system comprising a plurality of operation units operated by a plurality of users and a control device including a sound source device that generates a plurality of musical tones at pitches,
Each operating unit comprises a sensor means for detecting a motion mode or posture of the body of the user, and transmitting means for wirelessly transmitting the detected result of said sensor means as the operation data, and
Wherein the control device, assigned reception means, assigned to each operation unit to different pitches, each of said operation unit based on the operation data received from the operation unit for receiving the operation data from said plurality of operating units calling sound control system including a sound generation control unit, the to control the timing of the pitch of the sound and mute of a musical tone.   The sound generation control means reads automatic performance data including a pitch and a sounding timing of each note of the music at a predetermined tempo, and generates performance guide information for instructing a pitch and a sounding timing of each note. Pronunciation control system.

Images