Frank Cohen’s Free Resource Site for Testing, Architecture, and Scalability

STARWest 2016 Report – Where’s The Outrage

Day 1 at the STARWest 2016 conference in Anaheim, California and I’m left with the question: “Where’s The Outrage?”


I’m enjoying the new spirit of testers. There’s a spirit of optimism that the testing industry is prepared for the future. Maybe it’s just the incredibly sugary Mickey Mouse rice crispy treats they fed my pre-diabetic body…


But, I can’t help feel outraged at the companies that are standing in the way of the test industry’s success:

  • HP trashes the testing business with poor support and multiple failed technologies over the past 10 years, before selling its Load Runner, QTP, Quality Center business to Microfocus. Who? Microfocus, the company that has taken so long to do something with Borland’s Silk test tool. Microfocus didn’t want to talk about the acquisition since it will close a year from now. In the meantime who will be left standing around that knows anything about LoadRunner a year from now? Think of all the money everyone has spent on LoadRunner, and for what?
  • Apple has its own iOS (iPhone and iPad) testing tool that it still does not publish to the rest of us in the real world, and we have to wait until next week to see an Apple sanctioned release of Appium that supports iOS 10. I’m sorry but it will take another 10 minutes before Appium finishes running my functional test – Appium is so slow since it has to jump through Apple’s kludge to work with my mobile app.
  • SauceLabs is the defacto commercial tool company for the Selenium and Appium projects at this point – and they touted an upcoming round of investment that will swell their ranks to 160 people. While their solutions to deliver Selenium testing of Web apps in the cloud is great, they are still stuck running the Appium iOS emulators on expensive Mac OS X cloud machines and they still have to deal with the slowness of Appium running tests on an iPhone. They should have solved expensive and slow iOS solutions long ago.

The rising star at STARWest is DevOps. A few people recommended I read the Phoenix Project and the newer DevOps Handbook. It has lots of examples of organizations going from releases every 6 months to twice a day.


Melissa Tondi told me, “Automated tools should make the tester more efficient not less valuable. A good tester should be able to take the context and create a test: what do I have to do, what do I need to accomplish, how will I get there?” That’s the key of ending testing as we know it today, by helping testers transition into developers. They can still test, just now within the development organization.

Seems like the testing community wants the siloes to come down. But the test technology and methodologies are still left wanting.

Still to be defined is how to create standard packages along the creation of a new application in the development and operations team. Containers play an important role: Ansible, Docker, and Amazon Machine Images. Test tools that plug into these containers are important: Selenium, Sahi, Appvance, Soasta, soapUI, JMeter and others. And continuous integration and continuous deployment is important: Jenkins, Chef, Puppet.

And there it is again… outrage. It’s 2016. What little progress we’ve made and what a long journey there is ahead.

I pray for leadership and accelerated delivery for high quality solutions that will make our test industry achieve success!

-Frank Cohen

Selenium Tutorial for Beginners Now Available For Free Download

Frank Cohen’s Selenium Workshop is a 2-day course on Selenium and WebDriver (aka Selenium 2). Download the presentation deck and example files for free. The course covers the following topics.

  • Selenium Language Basics
  • How To Use Selenium in Rich Internet Application (RIA, using Ajax) Environments
  • How To Data Enable Selenium Tests Using TestMaker
  • Using Selenium Locators
  • Patterns and Anti-patterns for Selenium use
  • Browser compatibility testing
  • Testing in Flash/Flex Environments Using AMF Protocols
  • Integrating TestMaker Tests Into Your Continuous Integration Environment
  • How To Analyze Test Results Into Actionable Knowledge
Selenium Workshop for Beginners

Frank Cohen and others are available to present the Selenium Workshop to your team. Contact us for details.

Why The End Of Testing?

It’s a glorious time to be in the information technology (IT) industry. A senior executive at Huawei – China’s leading mobile technology company – told me they had achieved $1 Billion USD in license sales to mobile manufacturers. He said their goal for the next year is $1 Trillion. With a smartphone’s ability to run apps in so many people’s hands, the app development effort is worldwide and delivering more than 50,000 new apps every week.

With a potential market so big one would think every software tester and quality assurance (QA) analyst would be fully occupied with test projects. And that’s just my point, testers working in quality assurance groups outside of the engineering team are the walking dead, and worse, they don’t realize it. For it is impossible to deliver so many new apps every week using external testing groups and existing test techniques and protocols. 2016 is the end of the testing.

A new way of testing emerged this year. Testers became part of the development organization. This didn’t happen overnight. For the past 8 years I and many others have pushed for development organizations to get developers and testers to talk to each other and form close knit teams with common goals. That effort resulted in the Agile Software Development Lifecycle. Then I and others began pushing for developers and IT operations managers to talk to each other. We started the DevOps movement.

What this means to the average tester is clear:  When testers write and maintain test scripts they become software developers and each tester sees a $10,000 to $20,000 bump up in their salary. The days of the stand-alone tester and QA team are over.

This End of Testing Web site helps testers to make the transition, helps enterprise decision makers evaluate and adopt new technology and off-the-shelf software products with maximum benefit, and delivers free resources to help business analysts, IT operations managers, software developers, and testers participate in this most glorious time.


Founder of the

You have questions, we have experts. Ask your question here.

Available Experts

Frank Cohen, Expert

Frank Cohen, Founder of, 14 years testing and architecture, Inventor of PushToTest TestMaker and Appvance Unified Test Platform, Contributor to Selenium and Sahi, Author of 3 books on testing, Order 1 Hour of Time On A Skype, Phone Call, or Video Conference Call To Ask Frank Cohen for answers to your questions. 1 business day to schedule time.

Venkatesh Elangovan

Venkatesh Elangovan, Founder of, 7 years testing and architecture, World’s leading expert at testing Browser/Javascript/Ajax apps and Web pages, Contributor to Sahi test tool, Order 1 Hour of Time On A Skype, Phone Call, or Video Conference Call To Ask Venkatesh for answers to your questions. 1 business day to schedule time.