Back to Learning

Web-based Virtual Makeup Solution: Revolutionizing Online Beauty Experiences

Tencent RTC-Dev Team
Nov 14, 2024

Introduction

1.1 Market Demand for Virtual Makeup Technology

In the digital age, consumers' shopping habits are undergoing significant changes. Especially in the makeup industry, virtual makeup technology is rapidly becoming an indispensable tool. According to the latest market research, the global virtual makeup market is expected to reach 2.15 billion USD by 2025, with a compound annual growth rate of 20.6%. The growth is mainly driven by the following factors:

  • Increased consumer demand for personalized shopping experiences
  • Rapid development of e-commerce platforms
  • Demand of makeup brands to seek innovative marketing methods
  • Consumer preference for contactless shopping after the COVID-19 pandemic

1.2 Advantages of Virtual Makeup on Web Platforms

Compared to standalone applications, the virtual makeup solution for Web platforms has significant advantages:

  • Able to be experienced directly by users in the browser, with no need to download and install it
  • Suitable for desktop and mobile devices, with strong cross-platform compatibility
  • Easy to integrate into existing e-commerce websites and official brand websites
  • Easy to update and maintain, ensuring users always use the latest version
  • Conducive to improving the website conversion rate and user engagement

Overview of Web-based Virtual Makeup Technology

2.1 Core Technical Components

The implementation of Web-based virtual makeup technology relies on the collaboration of multiple core technical components:

a) Face detection and feature point localization

  • Detecting the user's face in real time with the computer vision algorithm
  • Precisely locating key feature points, such as eyes, lips, and contour

b) Image processing and color adjustment

  • Adjusting skin color, brightness, and contrast in real time
  • Applying various filters and beauty effects

c) 3D facial modeling

  • Building a 3D facial model based on 2D images
  • Achieving more natural makeup effects and light-shadow simulation

d) Real-time rendering

  • Using WebGL or similar technologies for efficient rendering
  • Ensuring a smooth user experience and instant feedback

e) Product virtualization

  • Converting real makeup products into digital assets
  • Simulating the texture and effects of different makeup products

2.2 Implementation Challenges

Despite the great potential of Web-based virtual makeup technology, its implementation still faces many challenges:

  • Browser performance limitations: Implementing complex image processing with limited computational resources
  • Network latency: Ensuring a smooth experience under various network conditions
  • Device compatibility: Adapting to devices with different resolutions and performance
  • Accuracy requirements: Requiring highly accurate facial recognition and makeup application
  • Realism: Simulating realistic makeup effects, including gloss and texture details
  • Asset customization: Supporting users to customize various styles of makeup effects

Tencent Beauty AR Web SDK

The Tencent Beauty AR Web SDK (hereinafter referred to as the SDK) is an advanced tool dedicated to providing high-performance, low-latency real-time beauty and AR effects for Web applications. As an important component of the Tencent Real-Time Communication (TRTC) product matrix, this SDK embodies Tencent's years of technical accumulation in the fields of computer vision, artificial intelligence, and real-time rendering.

Our goal is to provide developers and enterprises with a one-stop beauty AR solution, enabling them to easily and quickly integrate professional-grade beauty and AR features into Web applications without delving into complex underlying image processing algorithms.

Core Advantages of Tencent Beauty AR Web SDK:

  • High-performance real-time processing: It utilizes WebAssembly and WebGL technologies to achieve millisecond-level real-time beauty and AR effects, maintaining smooth user experiences even on mid-to-low-end devices.
  • Rich beauty effects: It provides a complete set of features from basic beauty to advanced attractive shape building, including skin smoothing, whitening, ruddy complexion, eye enlarging, and face slimming, in order to meet different scenarios' needs.
  • Advanced AR technology: It supports facial recognition, expression tracking, and real-time stickers, offering users a fun and interactive experience.
  • Cross-platform compatibility: It is specifically optimized for Web environments, ensuring consistent performance across various major browsers and devices.
  • Easy integration: It offers straightforward APIs and detailed documentation, significantly reducing the learning curve and integration difficulty for developers.
  • High customizability: It supports fine-tuning of parameters, allowing developers to customize beauty and AR effects according to specific needs. It also provides a professional material creation platform with an intuitive interface, enabling users to create makeup effects tailored to their business scenarios.

Application of the SDK in Web-based Virtual Makeup

This tutorial is based on the following steps to achieve virtual makeup in a web environment. We will use the SDK to quickly build a simple yet powerful virtual makeup application. Through this process, you will learn how to integrate the SDK, prepare makeup materials, and preview virtual makeup effects.

Quickly Integrating the SDK

Before integrating the SDK, you need to create a license. We provide a free test license for users to use. Refer to the Quick Start to quickly get through the demo project.

Creating Makeup Materials

To achieve a realistic virtual makeup effect, we need to prepare specialized makeup materials. The SDK supports various types of makeup materials, including eyebrows, eye makeup, colored contact lenses, lipstick, blush, and facial contouring. The overall process includes: material preparation (involving some PS picture processing work), material export (with existing material creation tools), and material preview (with the help of the demo project).

Refer to the following documents to complete material preparation and export.

Material Customization Guide Makeup Material Production Guide

After exporting the material, you can refer to the Material Management to obtain the completed material ID. The material ID is a string similar to 9C7E317E53997405,

Preview Effect

Just set the above material ID in the project

ar.setEffect([
  {
    id: 'xxx', // Set material ID
    intensity: 1,
    // filterIntensity: 0, // preset filter in makeup package
  },
  // stickers[0].id,
]);

javascript

You can also use built-in makeup materials to quickly experience the virtual makeup effect.

NameIDPreview
Princess9C7E317E53997405

https://webar-static.tencent-cloud.com/preset-effect/1648883456268/preview.png

Sense3EB3317E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883499668/preview.png
YoungBC5A317E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883532660/preview.png
Cool26B3A17E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883551935/preview.png
Freckles498A117E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883581370/preview.png
LadyC536317E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883604848/preview.png
Fairy9827017E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883622336/preview.png
Blue7AC1617E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883644315/preview.png
Tough6382517E53997405https://webar-static.tencent-cloud.com/preset-effect/1648883671200/preview.png
Handsome503FD17E53997405https://webar-static.tencent-cloud.com/preset-effect/1648733929230/preview.png

Try Tencent WebAR online

In addition to the virtual makeup feature, the SDK also provides a variety of virtual try-on capabilities. You can visit the following link to experience the try on demo online.

Summary

Web-based virtual makeup technology is rapidly becoming an important tool in the makeup industry. It meets customer demand for personalized shopping experiences. The Tencent Beauty AR Web SDK provides developers with a powerful and easy-to-use solution, making it simple and efficient to implement high-quality virtual makeup features on the Web platform. Through simple steps, including SDK integration, makeup material creation, and effect preview, developers can quickly build engaging virtual makeup applications. This not only provides innovative marketing means for makeup brands and e-commerce platforms but also offers consumers a convenient and fun online makeup experience. With continuous technological advancements, the application prospects of Web-based virtual makeup will be even broader.