Companies often use rigorous R&D processes to guide new product development, but are much less scientific when it comes to creating services. Not Bank of America, which has turned Atlanta-area branches into consumer laboratories. Here's how BofA set up its pathbreaking experiments.
Bank of America's Innovation & Development Team quickly realized that it would be very difficult to conduct a diverse array of experiments within the confines of a traditionally designed bank branch. Experiments require frequent changes in practices and processes, which neither the branch employees nor the physical facilities were prepared for. So the team decided to reconfigure the twenty Atlanta branches into three alternative models: Five branches were redesigned as "express centers," efficient, modernistic buildings where consumers could quickly perform routine transactions such as deposits and withdrawals. Five were turned into "financial centers," spacious, relaxed outlets where customers would have access to the trained staff and advanced technologies required for sophisticated services such as stock trading and portfolio management. The remaining ten branches were configured as "traditional centers," familiar-looking branches that provided conventional banking services, though often supported by new technologies and redesigned processes.
The group unveiled its first redesigned branch—a financial center—in the posh Buckhead section of Atlanta in the fall of 2000. A customer entering the new center was immediately greeted at the door by a host—an idea borrowed from Wal-Mart and other retail stores. At freestanding kiosks, associates stood ready to help the customer open accounts, set up loans, retrieve copies of old checks, or even buy and sell stocks and mutual funds. An "investment bar" offered personal computers where the customer could do her banking, check her investment portfolio, or just surf the Internet. There were comfortable couches, where she could relax, sip free coffee, and read financial magazines and other investment literature. And if she had to wait for a teller, she could pass the few minutes in line watching television news monitors or electronic stock tickers. What that customer probably wouldn't have realized was that all of these new services were actually discrete experiments, and her reactions to them were being carefully monitored and measured.
Design and production problems should be worked out off-line, in a lab setting without customers, before the service delivery is tested in a live environment.
—Stefan Thomke
To select and execute the experiments in the test branches, the I&D Team followed a detailed five-step process. The critical first step was coming up with ideas for possible experiments and then assessing and prioritizing them. Ideas were submitted by team members and by branch staff and were often inspired by reviews of past customer-satisfaction studies and other market research. Every potential experiment was entered into an "idea portfolio," a spreadsheet that described the experiment, the process or problem it addressed, the customer segments it targeted, and its status. The team categorized each experiment as high, medium, or low priority, based primarily on its projected impact on customers but also taking into account its fit with the bank's strategy and goals and its funding requirements. In some cases, focus groups were conducted to provide a rough sense of an idea's likely effect on customers. By May 2002, more than 200 new ideas had been generated, and forty of them had been launched as formal experiments.
Once an idea was given a green light, the actual experiment had to be designed. The I&D Team wanted to perform as many tests as possible, so it strove to plan each experiment quickly. To aid in this effort, the group created a prototype branch in the bank's Charlotte headquarters where team members could rehearse the steps involved in an experiment and work out any process problems before going live with customers. The team would, for example, time each activity required in processing a particular transaction. When an experiment required the involvement of a specialist—a mortgage underwriter, say—the team would enlist an actual specialist from the bank's staff and have him or her perform the required task. By the time an experiment was rolled out in one of the Atlanta branches, most of the kinks had been worked out. The use of the prototype center reflects an important tenet of service experiments: design and production problems should be worked out off-line, in a lab setting without customers, before the service delivery is tested in a live environment.
An experiment is only as good as the learning it produces. Through hundreds of years of experience in the sciences, and decades in commercial product development, researchers have discovered a lot about how to design experiments to maximize learning. We know, for example, that an effective experiment has to isolate the particular factors being investigated; that it must faithfully replicate the real-world situation it's testing; that it has to be conducted efficiently, at a reasonable cost; and that its results have to be accurately measured and used, in turn, to refine its design. These are always complex challenges, and, as Bank of America found out, many of them become further complicated when experiments are moved out of a laboratory and into a bank branch filled with real employees serving real customers in real time. To its credit, the I&D team thought carefully about ways to increase the learning produced by its experiments, with a particular focus on enhancing the reliability of the tests' results and the accuracy of their measurement. As Milton Jones, one of the bank's group presidents, constantly reminded the team: "At the end of the day, the most critical aspect of experimentation and learning is measurement. Measurements will defend you if done right; otherwise they will inhibit you."
