0

VS 2012 Web Client for Manual Testing

by Angela 11. March 2013 11:53

So in case you’ve missed my excited tweets/blog posts on what is coming in VS2012 Update 2, I wanted to spend a little time covering one of my favorites. If you’re a TFS Service user you’ve probably already seen this, but occasionally I run across people who go into autopilot and miss the new bells and whistled that magically appear every week or two. I know I have done it.

One of the features that recently showed up on TFS Service is a web client for Microsoft Test Manager, specifically around manual test execution. “WHAT?!” you say? YES, indeed. Now you can view test plans and test suites (they need to be created using the MTM client right now), create and manage test cases, execute manual test cases and create rich bugs FROM YOUR BROWSER ::head explodes from the awesome:: This will revolutionize tesst case execution for some of my clients that have been a little uneasy about installing the MTM client on all of their environments, and on end user tester’s machines. It does not have full feature parity with the full Microsoft Test Manager product (yet) but Microsoft has discussed the possibility of growing these tools over time. Here is a sneak peak of where those tools appear from within the Agile Planning web tools while logged into TFS Service (or if you have a test instance of TFS 2012 with Update 2 CTP 4 installed).

image

Don’t laugh at my burndown report, it’s a demo project so it isn’t updated in real-time and sometimes looks less-than-ideal if I’ve gone too long without doing a demo. 

Again, unless you have installed VS 2012 Update 2 CTP4 on your on-premise TFS server you will only be able to access these testing tools from a TFS Service instance, and I would NOT recommend putting a CTP on production (YMMV of course). That being said, let’s take a super quick look at what else you get with this new feature. 

Here is a view of a simple test plan with a couple of Test Suites and a handful of test cases already assigned to those suites.  Note you have options to: create new manual test cases, edit existing manual test cases, remove test cases from test suites, set Outcome to Pass/Fail/Blocked/Not Applicable and quite a bit more! I specifically say MANUAL test cases because exploratory testing is not currently supported on the web. You can also, at a glance, see who is assigned to execute each test case, the target environment configuration, as well as recent Outcome. You can even filter by tester and outcome!

image

On of my favorite productivity features is the ability to open the test case in the same window as the management tools, and edit it on the fly. You have similar capabilities in MTM in the Track Tab, ir if editing other types of work items in Team Explorer, and I definitely have wanted this ability in MTM for a while now so I love this!  Maybe a small enhancement, but as I spend a lot of time in MTM, any avoided clicks are a time saver for me and it adds up over time. In the upper right-hand section of the web tools you can see a “test case pane” option which can be set to Off, bottom or right. What you see below is the “bottom” option, and in the previous screenshot you may now notice it was set to “off”.

image

Another feature I will show off in this post is the actual running of a manual test case, which is similar to the desktop client version of the Manual Test Runner tool with a few caveats.  Note you still see each step, expected results, and data driven fields are still provided for the user running the test.  You can also set Outcomes for each step (pass/fail) as well as for the test case as a whole (pass/fail/blocked/not applicable). Notice you also have the ability to pause test case execution which is a feature of MTM 2012 in general :

image   image

An important thing to notice that is absent is rich text support in the test runner itself. You also do not have a built-in tool for snagging screenshots. A bummer, but not the end of the world when you consider the major benefits that a light-weight, no-install testing tool gives you. 

The last feature I want to highlight is rich bug creation from a test execution session. The support for rich bug creation has always been a really nice advantage of MTM, and the web tool gives you many of the key features that makes TFS such a clear win for defect tracking. Not all of the data collection is supported right now, but the big ones for me have always been repro steps and traceability which is there, as you can see:

image

Again this is meant to be lightweight, and hey, you never know what you might see in a future update!

There is a LOT more that I could cover, but this is really just a pleasure cruise around the highlights of the new web client for doing manual testing. If you want to learn more about MTM, agile testing, and pretty much anything new and cool in the area of Quality Assurance, check out Anu’s blog, it has always been an INVALUABLE resource. Also be sure to download and read the Test Release Management Guidance released very recently by the ALM Rangers.  It can help lead you down the right path in terms of managing your test plans based on your team’s process and product release cycles.

0

VS Live is Coming to Chicago this May! Special Discount for ALM User Group & Friends

by Angela 1. March 2013 10:27

email header2

So in case you haven’t noticed, Visual Studio Live is coming back to Chicago after many, many years of not being here.  This makes me very happy because a) I don’t have to pay for a flight and hotel in L.A. or Seattle, and b) well, see a) because cost is one factor that makes attending great conferences like this so hard to do for some of us.  Regular price of admission is $1,995 for the full 4 days, which isn’t bad when you think of all the awesome content you get.  Early bird registration ends soon and saves you a paltry $200 but wait, I can get you a MUCH better deal than that.

In case you did not make it out to the last Chicago Visual Studio ALM User Group you may have missed out on the discount code that I was able to get for all of you.  Sign up right now using the links in this email (or the code UGCH1) and you’ll save $500 off of the $1995 registration too, so it would be only $1495 for the full 4 day pass! This discount only applies to the “Best Value” package including all pre-conference workshops. So no travel costs, no hotel stay, AND save 25%. How can you NOT go? 

 

Visual Studio Live! Chicago tracks include:

  • ASP.NET
  • Azure / Cloud Computing
  • Cross-Platform Mobile
  • Data Management
  • HTML5 / JavaScript
  • SharePoint / Office
  • Windows 8 / WinRT
  • WPF / Silverlight
  • Visual Studio 2012 / .NET 4.5

 

Hope to see you at our next meeting, and at VS Live Chicago this May!

Tags:

.NET 4.5 | ALM | Application Lifecycle Management | ASP.NET | Azure | Cloud Computing | git | HTML5 | Microsoft Office | MSDN | SharePoint | Silverlight | Team Foundation Server | TFS | TFS 2012 | Visual Studio | Visual Studio 2012 | VS Live | Windows 8 | WinRT

1

Making TFS 2012 Work Item Types Read-Only Based on User Roles

by Angela 14. January 2013 09:35

Warning: this is most certainly NOT the most elegant solution to the problem. It’s a known shortcoming, or maybe it’s a feature, that you cannot limit access to an entire work item based on a user’s role in TFS.  I can limit transitions, and access to individual fields, but for very large and complex work item types, this is cumbersome and fragile. In a nutshell, I am trying to limit access to specific work item types, so that they are only editable by specific groups of people, and I had posted it to the forums to no avail.  So here is my ugly solution which for now, is sufficient. 

I started with Gregg’s post from 2009 that provided a workaround to my issue, but the error message thrown has changed in such a way as to make it even less intuitive as to what is going on. Below is the implementation of his suggestion and the resulting user experience:

image

image

The other issue with the above solution, is that it only prevents a user from CREATING that work item type, I need the user to also not be able to edit the item.

 

So I decided to try something a little different. I created a custom field, that is never displayed on any form, specifically for the use of locking down work items since we have several scenarios where we have to enforce read-only access to a work item type for certain users. I called it “UserAccessDenied”, since that is at least indicative of the issue when displayed to a user.

clip_image001

Like I said, the field is never displayed to a user, so it should never be populated.  We make that field required for any user that should NOT be editing the work item as below, which prevents them from saving it since it will always be empty:

clip_image002

 

Still not an awesome solution but at least now the provided error is a BIT more helpful, and the client was happy which is all that matters right? Smile 

image

image

 

You can provide a better experience to the user if you have the ability to create custom controls or write listeners that capture work item events to handle this. Where I am, they want something easy to maintain that does not require any kind of code to be written or maintained. So it is what it is.  If you, like me, would find the ability to set access permissions at the work item level, vote on my suggestion here.

 

And as always, if YOU have come up with a better way to do this, I’d love to hear about it!

Tags:

ALM | Application Lifecycle Management | MSDN | Power Tools | SDLC | TFS | TFS 2012 | TFS Administration | TFS Power Tools | Team Foundation Server | Visual Studio 2012 | Visual Studio | Work Item Tracking

0

Untangling TFS Connectivity to SSRS Snafus

by Angela 5. December 2012 08:55

So, as you may know, SSRS cannot host up reports for multiple instances of TFS, or for other applications period.  IOW, TFS SSRS instances MUST be dedicated. The reason is pretty obvious once you dig around in the properties of the reporting databases on your report server, but trust me on this unless you really WANT to know how it all works under the covers.

Long story short, we accidentally configured two different TFS application tiers (TFS1 running TFS2012 and TFS2 running TFS2010) to use the same instance of SSRS, doh!  We only need reporting on TFS1, for the record. After some troubleshooting we found that the connection strings for the TFS2010OlapReportDS and TFS2010ReportDS databases on the report server pointed to TFS2 and not the original one any more (TFS1). But oddly, the reports on the new TFS instance don't work either, I would have assumed that ONE of the instances would have had reporting that worked. I went to the Reports folder, and could see all of the reports for all of the team projects across the both TFS1 and TFS2 but always received this error, on every single report:

  • An error has occurred during report processing. (rsProcessingAborted)
    • Query execution failed for dataset 'dsIteration'. (rsErrorExecutingCommand)
      • For more information about this error navigate to the report server on the local server machine, or enable remote errors

 

Anyway, I digress. 

I figured a good first step was turning off Reporting on TFS2, and then reconfiguring SSRS for TFS1 in an effort to "reset" the connection.  But I could turn off reporting on TFS2.  I assumed that normally I *should* be able to do this, just un-check the "Use Reporting" feature and it's gone right? Maybe there is something amiss with the TFS 2010 instance? It is brand new, so not sure how it could already be corrupted.  Here is the error I receive when I try to "turn off" reporting on TFS1:

 

I did a lot of searching of MSDN and forums and couldn’t find anything that seemed to help.  I got desperate and tried a different order of operations, a "Hail Mary" if you will, and it worked!

I could not turn off reporting on TFS2 for some reason, but it occurred to me that the error message I was getting ("the database is not properly configured") was rather generic and could mean a LOT of things. And alas I do not have remote login access to the SSRS instance (don't get me started on the why or what of that!), so I couldn't even do research on it.  So instead I focused on getting TFS2 WORKING with SSRS even through the end goal was turning off reporting.  I went to the TFS1 app tier that had been connected to SSRS successfully originally, went into the Admin Console and unchecked "Use Reporting" to break the connection. That worked great, of course.

Next I went back to TFS2, and via the Admin Console verified the SSRS configuration information to hit the report server was all correct (it was), re-started all the jobs, and rebuilt the warehouse. Once reporting was working again on TFS2, I tried to turn it off again, and this time when I unchecked "Use Reporting" it was successful.  So apparently if reporting is broken, you cannot turn it off. Great.

Anyway, next I went back to TFS1, reconfigured reporting through the admin console and now all is well with the world again. Oy, I need a drink.

Tags:

ALM | Application Lifecycle Management | MSDN | SDLC | TFS 2010 | TFS 2012 | TFS Administration | TFS Power Tools | Team Foundation Server | Visual Studio 2012 | Visual Studio

0

Chicago Visual Studio ALM User Group - Holiday Party on Dec 12th 2012

by Angela 1. December 2012 12:48

Are you a regular attendee? Someone who hasn’t been to a meeting in a while? Someone who has never been and has been looking for the perfect topic? Well, c’mon down! Next week is our annual holiday meeting. In the past few months there has been a release of Visual Studio as well as an update, and not just any update but a MASSIVE update with lots of good new functionality. So go download it today!

We'll have fun giveaways for everyone who attends, but some particularly awesome giveaways for people who are willing to get up and demo their favorite VS 2012 (so anything related to VS, MTM or TFS) feature! It doesn't have to be a long or complicated demo, but it does need to highlight something about the latest release or the update that you find particularly useful or cool. Shoot me an email at Angela.Dugan@PolarisSolutions.com with the feature you want to highlight so I can ensure we don't end up with duplicates. Everyone that does a demo gets an additional gift, but we will also vote for one or two big winners to receive something extra cool! More details to come...  We will have many speakers that night, hopefully including you!

So far we have the following presenters and topics:

image

When: Wednesday, December 12, 2012 from 6:00 PM to 8:30 PM
Location: Microsoft-Downers Grove 3025 Highland Pkwy, Ste 300, Downers Grove

Agenda:6:00PM Food, drinks and prizes. 7:00PM VS 2012 Demo contest. 8:00PM Grand prizes awarded

Register here: http://chicagoalmug.org/
0

Why Isn’t TFSService In My Service Account Dropdown List?

by Angela 5. November 2012 09:45

Ever been migrating a TFS 2010 server and when you got to the place in the Application-Tier Only Wizard where you had to specify a Service account and POOF, your TFSService account did NOT appear as a possible option? Ruh-roh!  This is a known issue in TFS 2010, and you won’t encounter this in 2012 thankfully, but nonetheless. If it happens to you, hopefully this also works for your implementation!

Untitled

Now you certainly don’t want to be specifying a user account for this, but what on earth is a TFS admin to do? I got into this situation and fear not, there is NOTHING documented on-line to help you ::maniacal laughter:: Maniacal mostly because I beat my head on my desk for at least half a day trying to figure this out.  Nothing I could find on MSDN, the MSDN forums or any other searchable resource shed any light on the issue. I found the solution by calling in a favor with a couple of folks I know on the TFS product team.  I might seriously send them a cookie basket for being so awesome.  Seemed silly not to share my good fortune because this is a DOOZY if you ever run into it yourself.

Turns out, the values that go into this dropdown get collected by taking a poll of all of the TFS related SQL databases (configuration, warehouse, collections) referred to by the configuration file selected in the previous step. Obviously you need to select an account that can access all of the databases.  The account should a) not be dbo, b) not be db_owner, and c) needs to be a valid user with TFSADMINROLE and TFSEXECROLE. In my case, some folks had been having issues creating new Team Project Collections (because their TFS Admin accounts did not have proper permissions on the Data Tier) and so they logged into the AT as TFSService to create the collections ::head explodes::  Doing that makes TFSService dbo and dbo_owner and therefor pulls its name out of the proverbial hat to be used as the service account going forward.

So how do you fix it? a) make sure your TFS Admins have the appropriate rights on all of the servers they need to get their jobs done going forward and DO NOT take no for an answer.  Trust me, it’s brutal otherwise; b) Take TFSService OUT of the administrators group on the local server so no one can login as that user in the first place; c) go fix the TFSService account in the TFS related databases in SQL Server. This may seem scary, but I don’t know of another way.  Ask your DBA if you need to, it’s possibly their fault you got in this situation anyway Winking smile 

So what you need to do in SSMS to fix it?

  1. 1) Iterate through all of the TFS databases and change the Owner to something OTHER than TFSService; this will also reset the login associated to the dbo user. Keep in mind if this user is already in the Users group for that database, then they will need to be deleted from there first.
  2. Untitled

2) Add TFSService as a database user (Database | Security | Users –> New user…)

3) Assign them the following roles: TFSADMINROLE and TFSEXECROLE.

Untitled

 

And after you’ve given yourself carpal tunnel with the billion mouse clicks necessary to do this, you can restart the Application Tier Only wizard and you will find that now TFSService appears in your list. HUZZAH! ::throws confetti::

Untitled

Now ideally you will never get into this situation in the first place, but if you do, it’s not really documented other than this blog post – at least not that I know of. BIG THANKS to Brian MacFarlane and Ed Holloway on the TFS Product Team for helping me noodle through this issue.

Tags:

ALM | Application Lifecycle Management | MSDN | TFS | TFS 2010 | TFS 2012 | TFS Administration | Visual Studio

0

So You Were Forced to Use the dreaded TFS Collection /Recover Command, Now What?

by Angela 11. October 2012 08:23

Since we have used Recover on a production database and lived to tell the tale I thought I would share our experiences. If you read this post you will know that one of my client’s got themselves into a world of hurt where we needed to restore a nightly backup that was not detached.  I know, I know, detached backups are the way to go.  Well, now THEY know that too Winking smile  Nonetheless, sometimes you may find yourself needing to recover a TFS Team Project Collection (TPC) database, and if you’ve read the MSDN documentation you’ll know this is not an ideal situation. The Recover command is very lossy, BUT you get your data back. And in our case it was worth the risk.

So here is the backstory…  Someone deleted a Test Plan with a month’s worth of data in it, and if you know MTM you know there is no “undelete”. Restoring a backup was our only hope. BUT our nightly backups are SQL backups of the entire SQL Server instance, so undetached (we are addressing this NOW). Plucking one TPC out of there and attaching it is just not an option. And we did not have hardware to restore the entire thing and detach it properly.  So here is what we did:

  1. Restore the backed up TPC from the nightly backup into our dev TFS environment
  2. Used the TFSConfig /Recover command, followed by TFSConfig /Attach to get it attached in dev
  3. Used the TFSConfig /Recover command to get the TPC into the proper state
  4. Detach the hosed TPC from production
  5. Restore that detached version of the TPC to production
  6. Attach the backup to production (we actually hit an interesting bug in TFS 2010 at this point, so the attach was quite harrowing and involved an emergency hotfix to our TFS sprocs, I may blog about later.)

Now, I would love to say everything was perfect but the recover command did blow away some things that we had to get back into place before people could use the TPC again.  What we lost:

  1. All the security setting ever!
    • Collection level groups and permissions
    • Team Project (TP) level groups and permissions in every TP in the TPC
    • Permissions around Areas and Iterations in every TP in the TPC
    • Permissions around Source Control in every TP in the TPC
  2. SharePoint settings  (in every TP in the TPC). Settings on the SharePoint server themselves will be fine of course but you will probably see a “TF262600: This SharePoint site was created using a site definition…” error when you try to open the portal site that was once attached to those TPs. You will need to fix this in 2 places.
    • Go to TFS Admin Console, select the TPC you just restored and make sure the SharePoint Site settings for the TPC are correct. It will probably be set to “not configured” now.
    • Open team explorer (as an Admin user), and for each TP go to “Team Project Settings | Portal Settings” and verify everything there is correct. Ours were just plain gone so we had to enable the team project portal and reconfigure the URL.
  3. SSRS Settings – this will probably be fine if you restored the database as-is but we also renamed it as part of the restore, and so had to update the Default Folder Location through the Admin Console for the TPC in order for this to work again.

So word to the wise, make sure you understand what the settings above are for all of the TPs in your TPC BEFORE you perform a Recover command because chances are you will have to manually set them all back up.

Tags:

ALM | Application Lifecycle Management | MSDN | MTM | Microsoft Test Manager | Microsoft Test Professional | TFS | TFS 2010 | Team Foundation Server | VS 2010 | Visual Studio | TFS Administration

0

Visual Studio 2012 Launch Event Coming to Chicago in September!

by Angela 29. August 2012 04:50

You might have heard that the official launch of Visual Studio 2012 is coming soon! Alas we cannot all afford to hop on a plane and head out to Washington State to party with the product team. BUT, lucky for you, there are also going to be local launches held at major cities across the U.S. You might not have noticed because all the marketing jazz has been heavily focusing on the Windows Azure part of that event, but there is going to be some great content around the development tools as well. Now you know!

Join Polaris Solutions at this free launch in Oak Brook, IL (about 20 miles west of Chicago) event to check out some of Microsoft’s newest leading-edge tools, including Microsoft Visual Studio 2012, Windows Azure, Windows Server 2012, and Microsoft System Center 2012. You'll get the opportunity to engage with the experts (like me), get hands on with the new technology, and learn how to build modern applications both on-premises or in the cloud using the Microsoft platform.

A special Visual Studio 2012 launch track was recently added to the CHICAGO event with a keynote from Brian Harry himself. I know, cool right?! Smile In his talk, you will learn about how Visual Studio 2012 can help you evolve your development practices to maintain relevancy, adapt to change and deliver on the needs of the business, rise to the challenge of the “New Normal”, and elevate your skills to keep pace with the fast changing world of application development and delivery. Be sure to stop by after the keynote and visit us at the Polaris Solutions booth as well!

At the event, you will also be able to participate in a raffle for a chance to win an Xbox 360 + Kinect Bundle.  Get registered soon before it sells out:  https://msevents.microsoft.com/CUI/EventDetail.aspx?EventID=1032521310&Culture=en-US&community=0

Tags:

ALM | Application Lifecycle Management | Microsoft Test Manager | Microsoft Test Professional | SDLC | TFS 2012 | TFS | Team Foundation Server | Visual Studio | Visual Studio 2012

0

August Chicago ALM User Group - Announcing Git Integration with TFS

by Angela 16. August 2012 10:43

I know, Microsoft supporting non-.NET developers and non-Windows folks? Inconceivable! ::gasp:: 

OK, so if you’ve been paying attention for the past couple of years, you might already know that this has been happening slowly. But recently there have been some seriously MAJOR developments. First, Microsoft made Entity Framework open source, and now they have added MVC, ASP.NET and more to that list. Dogs and cats, living together, mass hysteria…and all that.  Then when you thought it couldn’t get crazier, they announced TFS integration with Git!  My head just exploded a little, how about yours?

Come to the Chicago Microsoft office on August 29th and meet one of the TFS product team members, you heard it, ONE OF THE DUDES WHO WRITES CODE FOR TFS ITSELF! Edward Thomson will be discussing how to take advantage of the new git-tf tool to synchronize a local git repository with Team Foundation Server.  This cross platform bridging tool is especially useful for cross-platform developers, such as iOS developers on Xcode.

Edward Thomson is a Software Development Engineer at Microsoft, where he works on cross-platform version control tools for Team Foundation Server.  Before joining Microsoft, Edward worked on numerous source code control tools for Microsoft and Unix platforms.

Register now to make sure you get a spot. Building security also requires it, and it helps me not order gobs of food no one will show up to eat.  So help a girl out huh?

Tags:

ALM | Application Lifecycle Management | MSDN | SDLC | TFS | Team Foundation Server | VS 11 Beta | Visual Studio | Open Source | git | TFS 2012

0

Microsoft Test Manager (MTM) Tip O’ the Day–Filtering test lists

by Angela 3. July 2012 07:41

Now, I am no @ZainNab, the guru of “Tips and Tricks”, but I occasionally run across features that have been staring me in the face for YEARS and yet somehow went completely unappreciated, sometimes unnoticed.  And then one day it hits me and OMG my life is easier, and I want to tell everyone.  Sure, it’s a bit embarrassing to admit sometimes given that I worked at Microsoft for 5.5 years focusing on the Visual Studio tools, but who hasn’t done that?  Not you? Really?  I am skeptical…  There are after all, a bajillion commands to try and remember. For real, if you don’t believe me, look at the entire book that Sara Ford and Zain wrote about it. It’s worth every penny and Amazon has a great deal on it, pick up a copy! Smile

So, back to my point. I was sitting in MTM, looking at a fairly daunting list of PBI based test suites, thinking “now which PBI’s were the ones where I had test cases to run again?”  I started thinking about writing a query, but that only helps is YOU are assigned to the test case, it doesn’t really help with test RUN assignment. Then it all came flooding back.  Wait, there’s this FILTER button to sort that out.  And conveniently it’s right there in front of my face ::face palm::  I felt a little better when no one else admitted to noticing it was there either. Maybe they were just being nice to me.  Either way, in case you didn’t notice it, check it out. Before:

Untitled

After, I have MUCH fewer test suites that I have to look at:

Untitled2

That’s my Microsoft Test Manager tip o’ the day!  I won’t be posting them every day like Zain has been doing on his blog around Visual Studio 2010 for the past couple of years, of course I also don’t mainline 5 hour energy like he does Smile  I will do them whenever I can.  Hope this was helpful! Feel free to post any tips of your own or shoot me a note if you have other questions or comments.

Powered by BlogEngine.NET 2.7.0.0
Original Design by Laptop Geek, Adapted by onesoft