At DevCrew, staying updated with the latest tools and technologies is essential to our mission of delivering cutting-edge AR experiences. The recent release of Lens Studio 5 has brought a wave of excitement and innovation to our team. In this blog, we’ll compare Lens Studio 5 with its previous versions, highlight its key features, and share how we’ve integrated it into our workflow to create exceptional AR projects.
The Evolution of Lens Studio
Lens Studio has come a long way since its inception as an internal tool at Snap Inc. in 2015, publicly launching in 2017. Initially, Snap had built 3,000 Lenses, with a third of Snapchat users engaging with them daily. Fast forward six years and over 330,000 creators have developed more than 3.5 million Lenses for 250 million daily active users. This rapid growth reflects the platform’s evolution and its importance to the AR community.
What’s New in Lens Studio 5 and How DevCrew is Implementing It
Lens Studio 5 is a major milestone, featuring a complete rewrite of the application to meet the growing needs of the AR community. At DevCrew, we’ve eagerly integrated Lens Studio 5 into our workflow and have already seen remarkable improvements. Here are the standout features and our findings:
Generative AI Features
Feature: Lens Studio 5 introduces integrated generative AI capabilities that empower creators to generate textures and 3D face masks directly within the platform. Among these features is a new 3D face mask generator, which seamlessly combines generative AI with Snap’s advanced face mesh technology, allowing for the effortless creation of intricate and expressive face masks.
Our Findings: The AI capabilities have streamlined our design process, enabling us to quickly create intricate and potentially viral self-expression Lenses. This feature is especially beneficial for team members with limited technical skills, making high-quality AR creation more accessible. For example, our designers can now use the 3D face mask generator to produce detailed and unique face masks within seconds, which previously required hours of manual work. The generated textures and masks are of high quality, reducing the need for extensive post-processing.
ChatGPT Remote API
Feature: Through a strategic partnership with OpenAI, Lens Studio now includes the ChatGPT Remote API. This powerful addition enables creators to build interactive Lenses using advanced natural language processing capabilities, all available for free. This integration opens up new possibilities for creating engaging and dynamic AR experiences.
Our Findings: We’ve utilized this API to develop more engaging and interactive Lenses. The natural language processing capabilities have opened up new possibilities for user interaction, making our AR experiences more immersive. For example, we created a Lens that uses ChatGPT to provide real-time responses to user queries, enhancing user engagement and making the experience more dynamic and personalized.
PBR Material Generation
Feature: Collaboration with Meshy has brought Physically Based Rendering (PBR) material generation to Lens Studio, revolutionizing the transformation of 3D meshes into high-quality, ready-to-use objects. This feature ensures that every 3D asset is rendered with stunning realism and detail, enhancing the overall quality of AR experiences.
Our Findings: This feature has elevated the visual quality of our AR projects. The PBR materials provide a more realistic and polished look to our 3D models, enhancing the overall user experience. For instance, in a recent AR project, we used PBR material generation to create lifelike textures for a virtual product showcase, making the items appear more tangible and appealing to users.
Enhanced Workflow Tools
Feature: Lens Studio 5 introduces new tools designed to streamline the development process. The Pinnable Inspector allows for the simultaneous inspection and comparison of objects, enhancing workflow efficiency. Additionally, the ability to open multiple projects at once facilitates seamless multitasking and project management, making development more intuitive and productive.
Our Findings: These tools have greatly improved our workflow efficiency. Being able to compare objects side by side and copy-paste between multiple projects has made our development process smoother and more efficient. For example, during a recent project, we needed to compare multiple versions of an asset to determine which worked best within the scene. The Pinnable Inspector allowed us to do this quickly and effectively, saving time and reducing errors.
Faster Performance
Feature: With Lens Studio 5, projects now open 18 times faster, significantly boosting productivity. Large projects that previously took 25 seconds to load now open in just a few seconds, allowing creators to work more efficiently and focus on their creative processes without the frustration of long wait times.
Our Findings: This improvement has drastically reduced downtime, allowing our team to focus more on creativity. The faster load times mean we can iterate and test our ideas more quickly, enhancing overall productivity. For instance, a complex AR project involving multiple assets and intricate interactions now opens in seconds, allowing us to quickly make adjustments and see immediate results. This efficiency has enabled us to take on more projects without compromising on quality.
Improved Version Control
Feature: The updated project format in Lens Studio 5 supports version control tools like Git, facilitating better project management and minimizing merge conflicts. This enhancement ensures smoother collaboration among development teams, allowing for more efficient and organized workflow management.
Our Findings: Version control integration has enhanced our collaboration efforts. It ensures that all team members are on the same page, reducing conflicts and making project management more seamless. For instance, our team can now work on different parts of a project simultaneously without worrying about overwriting each other’s work. The version control system tracks all changes, making it easy to revert to previous versions if needed and ensuring a smooth collaborative process.
Advanced Analytics
Feature: Lens Studio 5 includes enhanced analytics tools that offer deeper insights into user interactions with your Lenses. These advanced analytics enable creators to understand audience engagement better, optimize performance, and refine their AR experiences for maximum impact.
Our Findings: These analytics tools have allowed us to better understand user behavior and preferences. By analyzing data on user engagement and interactions, we can refine our Lenses to improve user satisfaction and retention.
Enhanced Asset Library
Feature: Lens Studio 5 boasts an expanded Asset Library, offering a wider range of pre-built assets such as 3D models, textures, and scripts. This extensive library provides creators with a rich collection of resources to streamline the development process and enhance the quality of their AR projects.
Our Findings: The enhanced Asset Library has accelerated our development process by providing a rich set of resources that we can easily incorporate into our projects. This has allowed us to focus more on creative design and less on asset creation from scratch.
Discoveries and Challenges in Lens Studio 5
While Lens Studio 5 introduces a wealth of innovative features, we encountered some challenges that are important to consider:
Resource Intensive: The advanced features and enhanced performance require higher system resources. We noticed that on older hardware, the software could be sluggish, and some features might not run as smoothly. Upgrading hardware or optimizing system settings might be necessary for the best experience.
Initial Bugs and Glitches: As with any major software update, Lens Studio 5 has its share of initial bugs and glitches. While these issues can temporarily hinder the user experience, we are confident that Snap Inc. is actively working to address and resolve them in upcoming updates.
Dependency on Internet Connectivity: Some features, like the ChatGPT Remote API, require a stable Internet connection. This dependency can be a limitation in environments with unreliable internet access.
High Expectations from Clients: With the introduction of advanced features, client expectations have also risen. Managing these expectations and delivering high-quality results within tight deadlines has been challenging but also rewarding.
No PNG Sequence Support: Unlike previous versions, Lens Studio 5 does not support PNG sequences. GIFs are the standard for animation sequences, which can be limiting in terms of quality and flexibility. This has required us to adjust our workflow and find alternative solutions for certain projects. Due to this deprecation, running legacy projects that rely on PNG sequences may present a challenge, as these projects will need to be adapted to the new format.
Manual Asset Optimization: In version 5, there is no built-in feature for optimizing assets. We have to perform asset optimization manually, which can be time-consuming and require additional effort. In previous versions, this process was more automated, and the lack of this feature has added an extra step to our development process.
Looking Ahead: As we continue to explore the possibilities with Lens Studio 5, we’re excited about the evolving landscape of AR development at DevCrew. Our engineering team has been working closely with Snap engineers, providing seamless feedback and sharing insights. We are hopeful that this collaboration will lead to tangible improvements in future updates, further enhancing the capabilities and usability of Lens Studio 5.
Whether you’re looking to elevate your brand through immersive AR experiences or seeking innovative ways to engage your audience, our team is dedicated to collaborating with you. Contact us today to explore how we can harness the latest AR technologies to craft impactful solutions that meet your unique objectives.
Let’s innovate together with Lens Studio 5!
