Used by millions of mobile developers, Unity Ads is the go-to ad solution to increase player engagement and achieve mobile success. It enables developers and publishers to acquire high quality users and grow revenue with video ads integrated into their mobile games.

Today, 34% of top 1000 free mobile games are made with Unity’s technologies. As the complexity of mobile app testing continues to grow, Rasmus Selsmark, QA Lead at Unity Ads, needed a solution that could help his team better focus on innovative agile development, while improving test coverage and confidence. More importantly, the solution would allow Unity to move faster and bring quality SDKs to game developers in a shorter amount of time.

Addressing the increasing complexity of mobile device testing

Unity, like many companies, relies on various tools and services to help them build, test, and deploy quality software. “As we grow bigger, automation is very important for us to get different teams, tools and environments integrated and help us get deliverables to move fast through our pipeline,” said Rasmus.

“Back in the days, we were happy with automating our tests locally on multiple devices. However, we gradually saw an increasing workload on infrastructure maintenance. And more importantly, we wanted to increase our testing coverage to ship our SDK with greater confidence.” The company needed a cloud-based test automation solution that would help them integrate the tools they already use to streamline their CI/CD pipelines, increase mobile device coverage and improve confidence in software quality.

Moving local automated tests to cloud-based infrastructure in the shortest time possible

In 2015, they started to look for ways of building robust test automation and using different cloud-based device farms. ”Prior to Bitbar Testing, we evaluated a few other test automation solutions. As we would like to get automation up and running as soon as possible by sticking to open source frameworks, Bitbar Testing did a good job at supporting all the open standards and providing comprehensive APIs that meet our need for a very customized testing approach. This allowed us to seamlessly integrate with our tools and directly pull test reports to our developers”, explained Rasmus.

“On the other hand, we wanted to lessen the pains of hosting in-house environments. That’s where Bitbar Testing again came in with lots of unique device models and OS versions from different countries. During our POC, we also realized that Bitbar Testing has the ultimate scalability in that we can execute tests on any number of devices in parallel. That would significantly boost our test efficiency.”

"With Bitbar Testing, we have implemented an optimal DevOps process. The automation and scalability of Bitbar Testing allows us to execute more tests on more devices within the same amount of time. This gives us the confidence to move our SDK through all phases of the pipeline and deliver quality SDKs to game developers rapidly."

Rasmus Selsmark, QA Lead at Unity Ads

Delivering quality mobile SDKs with greater confidence

“Automation nowadays is widely adopted in many organizations, we also wanted to set it up in a way that actually calls out value,” stressed Rasmus. “By saying value, we meant that it should help us build, test, deploy software at a daily rate with confidence. With Bitbar’s solutions, we’ve realized our goal.”

Bitbar Testing has lots of out-of-the-box integrations with development, ticketing, issue tracking, deployment and collaboration tools so that customers can easily optimize their DevOps toolchains. Unity relies on Bitbar’s comprehensive APIs to integrate their build system with Bitbar Testing so that each build can be passed through the pipeline for extensive QA over the API. Unity utilizes Jenkins and Travis on a daily basis to trigger tests executed on a large set of devices thanks to the capability of unlimited device concurrency at Bitbar Testing.

“Bitbar really has a versatile device cloud. Every time we want to replicate or debug reported issues on a specific device, we can always find the right device model from Bitbar Testing,” said Rasmus. “With Bitbar Testing, we have implemented an optimal DevOps process. The automation and scalability of Bitbar Testing allows us to execute more tests on more devices within the same amount of time. This gives us the confidence to move our SDK through all phases of our pipeline and deliver quality SDK to game developers rapidly”. Unity has been a happy customer of Bitbar for over two years now and sees Bitbar Testing as a crucial tool in shipping their SDK.