Performance Testing has certainly taken centre stage in recent years amongst all applications be they web, mobile (native, web, hybrid), for the right reasons. End users expect exemplary performance from applications in terms of availability, responsiveness, regardless of how rich the application design may be, how complex the architecture is, how it may be hosted, etc. And when competition is ready to offer a base-lined performance and more, app makers don’t have much of a choice than to provide compelling performance as a core non-functional quality attribute. Tools both open source and commercial are flooding the market to enable teams take on performance testing, specifically as part of mobile apps testing. However one core attribute that many are missing or ignoring is that, just as how compatibility and inter-operability make a big difference in how an application performs functionally, core device parameters also need to co-exist with the application from a performance standpoint. If this is not evaluated and kept in check, it can have a huge adverse impact on the performance of the application.
One may think isn’t this quite straightforward – what is rocket science about measuring device performance, in alignment with application performance, especially on mobile devices? It is not fully and effectively embraced today, as yet, by app makers, though we predict that this will soon be an importance piece of an organization’s performance testing services portfolio.
If you wonder about the presence of apps to measure such device parameters, there are a few available on app stores. But those as well are more end user centric, and not something that is easily leverage-able by product teams. This was the pain point that we at the QA InfoTech performance team, started as a problem statement with, in building our own device performance measuring tool. This is a tool that is usable by all within a product team, in a range of ways – manually, automatically as well as remotely from a cloud. A range of customizable parameters including memory, CPU, battery, network, server URL availability etc. are constantly monitored for iOS and Android devices. Adequate notifications and alarms are raised when defined thresholds are reached. This simple yet powerful framework is something we hope to make open source and share with the community down the line – as end of the day, the cause this supports, will make a significant difference in the performance of apps in real time user scenarios.
Stay tuned for a more detailed technical write up on how this tool works, very soon on our website knowledge center.