Robot Streaming
Description of the Feature
TUIRoomKit supports the use of robot push streaming, allowing users to push local or online media files into the room. In some scenarios, meetings may require the push of pre-recorded instructional videos or online video streams to online classrooms for users to watch and learn. TUIRoomKit can meet these needs, achieving automated and efficient video playback.
To use this feature, you need to subscribe to the TUIRoomKit Monthly Package. An robot stream will be considered a user in a room, which will incur call duration fees. For more information, please refer to the Billing of Audio and Video Duration. Transcoding operations will be performed during the process of connecting robot streams, thereby incurring transcoding fees. For more information, please refer to the Billing of On-Cloud MixTranscoding.
Application Scenario
Watching together, listening together, playing together, and learning together – experiences that previously required offline, face-to-face interaction are increasingly being moved online. The ability to watch movies, listen to music, and then discuss and share opinions with friends thousands of miles away is a magical real-time interactive experience that is loved by young people today, becoming a focus and mainstream direction of current audio and video products.
TUIRoomKit input media stream feature allows sharing of external media streams within a room. Users can use this feature to share music, movies, lectures, courses, and other media content with other users in the room, engaging in real-time interaction with them. Platforms can leverage this new feature of TUIRoomKit to quickly implement a watch together scenario. In addition to watching movies and listening to music together, the input media stream capability of TUIRoomKit can also bring more innovative possibilities to the platform in scenarios such as interactive classrooms, sports competitions, and web conferences.
Usage: Using RTMP for streaming
TUIRoomKit supports RTMP standard protocol for streaming. Depending on the situation, you can choose to install OBS, FFmpeg, or other RTMP libraries for streaming.
Using FFmpeg to publish streams
FFmpeg requires specific command configuration parameters for different scenarios, so you should have some experience with FFmpeg. Below are commonly used FFmpeg Command Line options; for more FFmpeg Options, please refer to the FFmpeg official website.
FFmpeg Command Line
ffmpeg [global_options] {[input_file_options] -i input_url} ... {[output_file_options] output_url}
Common FFmpeg Options
Option | Description |
-re | Reads input at native frame rate, generally only used for reading local files |
Among them, the configurable options for output_file_options include:
Option | Description |
-c:v | Video Encoding, recommended to use libx264 |
-b:v | Video bitrate, for example, 1500k means 1500kbps |
-r | Video Frame Rate |
-profile:v | Video profile, specifying baseline will not encode B frames, TUIRoomKit backend does not support B frames |
-g | GOP frame interval |
-c:a | Audio Encoding, recommended to use libfdk_aac |
-ac | Number of channels, fill in 2 or 1 |
-b:a | Audio Bitrate |
-f | Specify format, fixed fill in flv , send to TUIRoomKit using FLV container |
Usage
The following example uses FFmpeg command to read files and push to TUIRoomKit, note the quotes around the URL.
ffmpeg -loglevel debug -re -i sample.flv -c:v libx264 -preset ultrafast -profile:v baseline -g 30 -sc_threshold 0 -b:v 1500k -c:a libfdk_aac -ac 2 -b:a 128k -f flv 'rtmp://rtmp.rtc.qq.com/push/yourRoomId?userid=yourUserId&sdkappid=xxxxxxxxx&usersig=xxxxxxxxxx'
The explanations for the parameters in the above command are as follows:
Parameter | Meaning |
-i sample.flv | The media file that needs to be streamed to TUIRoomKit. You can replace sample.flv with the local or online media file you need to stream. |
yourRoomId | The Room ID you need to stream to. You need to replace yourRoomId with your actual RoomId. |
userId | The UserID you need to stream with. You need to change the value after "=" to the actual userId. |
sdkappid | Your sdkappid, which you have previously obtained in Activate Service. You need to change the value after "=" to the actual sdkAppID. |
usersig | Your usersig, which you have obtained when logging into TUIRoomKit. You need to change the value after "=" to the actual userSig. |
When you need to implement the above feature in code, you can use the relevant FFmpeg library on your platform or invoke FFmpeg through the command line to achieve the above command.
Using OBS to publish streams
Prerequisites
Step 1. Select a source
In the Sources panel at the bottom, click **+**, and select a source based on your needs. Common sources include the following:
Source | Note |
Image | Publishes a single image |
Image Slide Show | Publishes multiple images (you can determine the order of playback and whether to loop the playback) |
Scene | Inserts an entire scene to enable various streaming effects |
Media Source | Uploads a local file and publishes it as a live stream |
Text | Adds real-time text to your stream |
Window Capture | Captures and publishes the window you select in real time |
Video Capture Device | Captures and publishes the images captured by a camera in real time |
Audio Input Capture | Audio live streaming (audio input device) |
Audio Output Capture | Audio live streaming (audio output device) |
Step 2. Set publishing parameters
1. In the Controls panel at the bottom, click Settings.
2. Click Stream and select Custom for Service.
3. Enter
rtmp://intl-rtmp.rtc.qq.com/push/
for Server.4. Enter a stream key in the following format:
Room ID?sdkappid=Application&userid=User ID&usersig=Signature
Replace "Room ID", "Application ID", "User ID", and "Signature" with the actual values, for example:
yourRoomId?sdkappid=140*****66&userid=******rtmp2&usersig=eJw1jdE***************ZLgi5UAgOzoMhrayt*cjbmiCJ699T09juc833IMT94Ld7I0iHZqVDzvVAqkZsG-IKlzLiXOnEhswHu1iUyTc9pv*****D8MQwoA496Ke6U1ip4EAH4UMc5H9pSmv6MeTBWLamhwFnWRBZ8qKGRj8Yp-wVbv*mGMVZqS7w-mMDQL
Step 3. Configure the output
Because RTMP does not support B-frames, set the video encoding parameters as follows to remove B-frames.
1. Go to Controls > Settings > Output.
2. Select Advanced for Output Mode. The recommended Keyframe Interval is 1 or 2. For CPU Usage Preset, select ultrafast. For Profile, select baseline. For Tune, select zerolatency. And for x264 Options, enter
threads=1
, and then click OK.Warning:
You need to remove the B-frames in RTMP streams, otherwise the connection will be disconnected after pushing. To achieve this, select baseline for Profile.
Step 4. Set video parameters
You can set video resolution and frame rate under the Video section of Settings. Resolution determines the clarity of video shown to audience members. The higher the resolution, the clearer the video. Frame rate (frames per second) determines playback smoothness. Typical frame rate falls in the range of 24 fps to 30 fps. Playback may stutter if frame rate is lower than 16 fps. Video games require higher frame rate and tend to stutter at a frame rate lower than 30 fps.
Step 5. Configure advanced settings
To reduce end-to-end delay, we recommend you do not enable Stream Delay.
Keep Automatically Reconnect enabled and make Retry Delay as short as possible so that the publisher can be reconnected quickly after a disconnection occurs due to network jitter.
Step 6. Publish the stream
1. In the Controls panel at the bottom, click Start Streaming.
2. If streaming is successful, the bottom bar will show streaming statistics, and the entry of a user will be recorded by the monitoring dashboard.