ReSpeaker Core v2 Seeed ReSpeaker Core v2 is designed for voice interactive applications. It is based on quad-core ARM Cortex-A7, up to 1.5Ghz, and 1GB RAM on-board. Besides, it features six microphone array w ith necessary speech algorithm, like DoA(Direction of arrival), BF(Beam-Forming), AEC(Acoustic echo cancellation) and etc. ReSpeaker Core v2 runs GNU/Linux operation system.
Debian-based Linux system SDK for speech algorithm w ith Full documents C++ SDK and Python w rapper Speech algorithms and features Keyw ord w ake-up BF(Beam-Forming) DoA (Direction of arrival) NS(Noise suppression) AEC (Acoustic echo cancellation) and AGC (Automatic gain control) Specification Features CPU Quad-Core Cortex-A7,up to 1.5GHz GPU Mali400MP, Support OpenGL ES1.1/2.0 Memory 1GB RAM(Core Module includes RAM and PMU) System Operating Voltage:3.
① 3.5m m Headphone jack: Output audio. You can plug active speakers or Headphones into this port. ② USB OTG: This USB Port is used to connect to your computer via serial mode of putty (or other serial tools). ③ USB Pow er Input: This port is used to provide pow er for Respeaker Core v2. ④ Speaker Jack: Output audio for passive speakers. Jst 2.0 Socket. ⑤ UART: You also can connect the ReSpeaker Core v2 w ith your computer via this UART port.
Ⓑ HDMI: Output video. Ⓒ Bluetooth and WIFI Antenna: The onboard Antenna is for WIFI and Bluetooth. Also w e provide a interface for 2.4G Antenna or PCB Antenna. Ⓓ Grove Socket: Grove Socket for digital or I2C.
Applications Smart speaker Intelligent voice assistant systems
Voice recorders Voice conferencing system Meeting communicating equipment Voice interacting robot Car voice assistant Other scenarios need voice command Getting Started Prerequisites ReSpeaker Core V2 Wi-Fi Netw ork 4GB (or more) SD card and SD card reader PC or Mac USB To Uart Adapter (Optional) 5V 1A Micro USB adapter for pow er (Optional) tw o Micro-USB cables Caution Please plug the USB cable gently, otherw ise you may damage the interface.
Step 4. After w riting the image to the SD card, insert the SD card in your ReSpeaker Core V2. Pow er the board using the PWR_IN micro usb port and DO NOT remove the SD card after pow ering on. ReSpeaker Core V2 w ill boot from the SD card, and you can see USER1 and USER2 LEDs light up. USER1 is typically configured at boot to blink in a heartbeat pattern and USER2 is typically configured at boot to light during SD card accesses. Now , you should go to the next part: Serial Console. B.
Step 2. Check at your computer if the serial port has risen: Window s: check the device manager, there should be new serial deviced named COMx w hich x is an increasing number. If you use w indow s XP/7/8, maybe you need install w indow s CDC drivers. Linux: ls /dev/ttyACM* , you should get /dev/ttyACMx w here x w ill vary depending on w hich USB port you used. Mac: ls /dev/cu.usb* , you should get /dev/cu.usbmodem14xx w here xx w ill vary depending on w hich USB port you used. Step 3.
on the Uart port of the Respeaker. Connect the Tx pin on the Arduino to the Tx pin on the Uart port of the Respeaker. And lastly, connect the Arduino to your PC/Mac via the Arduino's USB cable. Now check that your Mac or Linux PC finds your Arduino by typing this command: ls /dev/cu.usb* (Mac) ls /dev/ttyACM* (Linux) You should get back something like: /dev/cu.
Now find the IP address of your ReSpeaker by using the command below . ip address In the example below , w e can see that this ReSpeaker's IP address is 192.168.7.108 root@v2:/home/respeaker# ip address 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.
ssh respeaker@192.168.***.*** // password: respeaker Note Note that if experience slow performance using SSH, please sw itch to a less crow ded WiFi netw ork. B. VNC In order to acquire the authorization from Alexa, you need to use VNC View er. The system has VNC server built-in. The VNC server w ill launch the lxqt desktop GUI w hich is a lightw eight Qt desktop environment. The VNC service also starts automatically.
arecord -Dhw:0,0 -f S16_LE -r 16000 -c 2 hello.wav aplay -Dhw:0,1 -r 16000 -c 2 hello.wav # record 8 channels audio # there are 6 microphones on board, and ac108 compose the 2 remaining channels. arecord -Dhw:0,0 -f S16_LE -r 16000 -c 8 hello_8ch.wav 2. Test via PulseAudio First check w hether the PulseAudio is running: respeaker@v2:~$ ps aux|grep pulse|grep -v grep respeak+ 1109 0.0 0.
After succeed you w ill see: Now you can close the VNC client. The follow ing commands can be executed in the SSH (If you prefer the VNC desktop, the terminal in VNC desktop also w orks). Step 3. Have fun with Alexa Applications We provide three python files based on Alexa, you can choose them freely. Alexa-tap.py : Use the Enter key to w akeup Alexa, w e call it Alexa Tap to Play. ns_kw s_alexa.py : Use the key w ord Alexa to w akeup Alexa, w e call it Alexa Hands-Free. ns_kw s_alexa_w ith_light.
pip install pixel-ring python ns_kws_alexa_with_light.py The same as last one, say Alexa to trigger the conversation w ith Alexa. You w ill the LED shinning w hile this program is running. Play with Dueros (Voice assistance of Baidu) The same as AVS, the only difference is that you need to delete one profile file. Before get the authorization, you should tap the command below to delete the avs.json. rm -f ~/.avs.
sudo apt install python-mraa python-upm libmraa1 libupm1 mraa-tools Step 2.
Get ONE Now Get ONE Now In this example, w e're gonna to listen on the trigger of the Grove PIR sensor, in Python code. Connect the Grove PIR sensor's D1 pin to the ReSpeaker Core v2's header pin 0 w ith jumper. Don't forget to w ire the VCC and GND at the same time. Then copy the code below into a new file and save it as a python file, name as m raa_pir.py. Copy this file into your ReSpeaker Core v2. import mraa def on_trigger(gpio): print("pin " + repr(gpio.getPin(True)) + " = " + repr(gpio.
This is an example for the Grove Digital Light Sensor, w hich is copied from the UPM github repo. Please plug the PIR Motion Sensor into your Respeaker Core v2 via the Grove socket. Then copy the code below into a new file and save it as a python file, name as tsl2561.py. Copy this file into your ReSpeaker Core v2. #!/usr/bin/env python # Author: Zion Orent # Copyright (c) 2015 Intel Corporation.
You should choose Seeed-8mic-voicecard for both record and play device. And you can choose 1/2/4/6/8 channels to record and play. As you can see, there are 8 channels in the picture, how ever there are no data in channel 7 and 8. That is because this tw o channels are the playback channel. The channel 7 is for 3.5mm Headphone and the channel 8 for the JST2.0 Speaker (If you do not have a JST cable, you can use jumpers as w ell). Say, w e use JST Speaker: Step 1.
Step 3. When you get into the Serial Console， you can setup the WiFi Q3: How to adjust the volume? A3: You can use Alsamixer to adjust the playback volume and capture sensitivity. Step 1. Tap the follow ing code to open Alsamixer: Alsamixer Step 2. Press F6 on your keyboard to choose Seeed-8m ic-voicec card. Step 3. You w ill find the interface as the picture below . You can choose the playback voice or record channel by pressing Right or Left key.
Tech Support Please do not hesitate to contact techsupport@seeed.cc if you have any technical issue. Or submit the issue into our forum. Resources [PDF] Dow nload PDF of This Wiki [PDF] Rockchip RK3229 Datasheet V1.
