So in case you’ve missed my excited tweets/blog posts on what is coming in VS2012 Update 2, I wanted to spend a little time covering one of my favorites. If you’re a TFS Service user you’ve probably already seen this, but occasionally I run across people who go into autopilot and miss the new bells and whistled that magically appear every week or two. I know I have done it.
One of the features that recently showed up on TFS Service is a web client for Microsoft Test Manager, specifically around manual test execution. “WHAT?!” you say? YES, indeed. Now you can view test plans and test suites (they need to be created using the MTM client right now), create and manage test cases, execute manual test cases and create rich bugs FROM YOUR BROWSER ::head explodes from the awesome:: This will revolutionize tesst case execution for some of my clients that have been a little uneasy about installing the MTM client on all of their environments, and on end user tester’s machines. It does not have full feature parity with the full Microsoft Test Manager product (yet) but Microsoft has discussed the possibility of growing these tools over time. Here is a sneak peak of where those tools appear from within the Agile Planning web tools while logged into TFS Service (or if you have a test instance of TFS 2012 with Update 2 CTP 4 installed).
Don’t laugh at my burndown report, it’s a demo project so it isn’t updated in real-time and sometimes looks less-than-ideal if I’ve gone too long without doing a demo.
Again, unless you have installed VS 2012 Update 2 CTP4 on your on-premise TFS server you will only be able to access these testing tools from a TFS Service instance, and I would NOT recommend putting a CTP on production (YMMV of course). That being said, let’s take a super quick look at what else you get with this new feature.
Here is a view of a simple test plan with a couple of Test Suites and a handful of test cases already assigned to those suites. Note you have options to: create new manual test cases, edit existing manual test cases, remove test cases from test suites, set Outcome to Pass/Fail/Blocked/Not Applicable and quite a bit more! I specifically say MANUAL test cases because exploratory testing is not currently supported on the web. You can also, at a glance, see who is assigned to execute each test case, the target environment configuration, as well as recent Outcome. You can even filter by tester and outcome!
On of my favorite productivity features is the ability to open the test case in the same window as the management tools, and edit it on the fly. You have similar capabilities in MTM in the Track Tab, ir if editing other types of work items in Team Explorer, and I definitely have wanted this ability in MTM for a while now so I love this! Maybe a small enhancement, but as I spend a lot of time in MTM, any avoided clicks are a time saver for me and it adds up over time. In the upper right-hand section of the web tools you can see a “test case pane” option which can be set to Off, bottom or right. What you see below is the “bottom” option, and in the previous screenshot you may now notice it was set to “off”.
Another feature I will show off in this post is the actual running of a manual test case, which is similar to the desktop client version of the Manual Test Runner tool with a few caveats. Note you still see each step, expected results, and data driven fields are still provided for the user running the test. You can also set Outcomes for each step (pass/fail) as well as for the test case as a whole (pass/fail/blocked/not applicable). Notice you also have the ability to pause test case execution which is a feature of MTM 2012 in general :
An important thing to notice that is absent is rich text support in the test runner itself. You also do not have a built-in tool for snagging screenshots. A bummer, but not the end of the world when you consider the major benefits that a light-weight, no-install testing tool gives you.
The last feature I want to highlight is rich bug creation from a test execution session. The support for rich bug creation has always been a really nice advantage of MTM, and the web tool gives you many of the key features that makes TFS such a clear win for defect tracking. Not all of the data collection is supported right now, but the big ones for me have always been repro steps and traceability which is there, as you can see:
Again this is meant to be lightweight, and hey, you never know what you might see in a future update!
There is a LOT more that I could cover, but this is really just a pleasure cruise around the highlights of the new web client for doing manual testing. If you want to learn more about MTM, agile testing, and pretty much anything new and cool in the area of Quality Assurance, check out Anu’s blog, it has always been an INVALUABLE resource. Also be sure to download and read the Test Release Management Guidance released very recently by the ALM Rangers. It can help lead you down the right path in terms of managing your test plans based on your team’s process and product release cycles.