无线和移动设备制造商 自动化测试及管理解决方案

sevenxue

全球无线和移动设备制造商所面临的挑战
□无线和移动终端的功能越来越复杂；测试难度和工作量逐步加大，测试成本快速上升。
□市场竞争日趋激烈，每款产品的生命周期越来越短。设备制造商都希望领先于竞争对手把自己的新产品投放市场，留给设备制造商的研发和测试周期就越来越短。
□手机产业链的分工越来越细，每一个环节的测试要求不尽相同，测试资源很难共享，沟通和管理的成本和难度太大，测试效率低下。
□随着3G的发展，基于业务应用层面开发和测试的比重会越来越大，复杂度也越来越高。
□手机的用户（网络运营商/最终使用者）对手机的质量要求越来越高，因手机质量问题的召回的成本也越来越高
□手机的用户（网络运营商/最终使用者）对手机的质量要求越来越高，因手机质量问题的召回的成本也越来越高
全球无线和移动设备制造商的测试需求
□射频测试，协议栈测试，电磁兼容性测试，安全性测试
□功能性测试、压力测试、性能测试和回归测试
□不同操作系统和硬件平台之间的兼容性测试
□不同网络环境下的交互性测试
□与其它厂商制造的设备之间的一致性测试
□应用程序之间并发性测试
手工测试的局限性
□可靠性低：测试工程师在很小的手机屏幕上操作太久则容易疲倦，造成测试可靠性下降。比如，测试工程师可能会混淆‘O’和‘0’，或无意中跳过测试规范中的一页。
□准确性差：比如，测试工程师难以发现包含100个字符的文本信息中的一个错误，或由于一步操作失误而不得不重新开始一个测试用例。
□可追踪性差：很多偶发的错误的出现具有很大的随机性，手工测试难以发现出现概率较小的错误，或难以重现之前发现的错误。
□一致性差：当测试并发事件时，需要同时操作多个终端或同时运行多个应用程序。手工操作很难控制。 新闻报道：
Winners and Losers Emerge from BenQ Mobile's Bankruptcy
John Walko, EE Times Europe, September 29, 2006
…one main reason for the former Siemens handsets operation filing for bankruptcy Friday (Sept.29) is down to handset delays, testing and acceptance problems that conspired to prevent devices getting to market on time which has “which has proved catastrophic for revenues, profits and cash flow”.

T-Mobile, Cingular pull Razr due to glitch
Robert McMillan, IDG News Service, March 12, 2006
T-Mobile USA Inc. and Cingular Wireless LLC have suspended sales of Motorola Inc.'s Razr cell phones because of a bug that causes some of the ultra-thin mobile phones to drop calls…
Treo Owners Sue Palm
Tom Krazit, IDG News Service, September 22, 2005
Three owners of Palm's Treo 600 and 650 hybrid phone/personal digital assistants have filed a lawsuit claiming the devices are inherently defective and are seeking an injunction barring the sale of the popular devices..
HP's H6315 Phone on Hold at T-Mobile
Tom Krazit, IDG News Service, March 24, 2005
T-Mobile USA has suspended sales of Hewlett-Packard's IPaq H6315 device after users reported numerous software glitches with the device, spokespeople from both companies confirmed Thursday…
Mobile Operators at Risk of Losing $6 Billion Due to Multimedia Messages Interoperability Problems
Mobixell, NEW YORK, January 20, 2005
According to recent market surveys, among them a study by Juniper Research, the global Multimedia Messaging Service (MMS) market will reach $42.5 billion in 2005, growing to 161.3B in 2009...  These surveys found that although providers are seeing significant growth in MMS usage, MMS has so far failed to deliver on its revenue promise - specifically, due to problems of handset compatibility and interoperability…  
现有的自动化测试工具已难以适应无线和移动行业日益增长的测试需求
□传统的自动化测试工具需要用户具有很强的编程技巧，需要编写大量脚本(C/Tcl/Tk…)来创建测试用例。
□QA部门(组织)熟悉行业测试规范，但是一般没有自己的技术开发团队，难以完成大量的编程工作。
□传统的自动化测试工具大多专门为某个手机平台或操作系统设计，很难应用于其它手机平台或操作系统。
□市场上终端采用的硬件平台、操作系统以及网络制式各不相同。在传统的自动化测试工具中开发的测试用例很难在不同的终端之间进行移植。[upload=jpg]UploadFile/2007-5/07511@52RD_图片1.jpg[/upload]
TestQuest公司简介
Test Expertise
–Leader in automated functional test solutions for embedded systems
–Specialize in test solutions for mobile and wireless devices and applications
Global Distribution
–Headquarters: Minneapolis, MN; moving to Silicon Valley
–European subsidiary based in UK
–Offices in India and China; distributors in Korea and Taiwan; expansion to Japan beginning in FY06
–Establishing test solution partnerships with leading system integrators (e.g., Wipro, Tata Consultancy Services, Satyam) and global test equipment manufacturers in the US and Europe
Growing Company
–Adding average of 30 new customers per year (FY02 – FY06)
–Customers include four of the five world’s largest handset manufacturers, three of the world’s top operators, leading independent mobile software vendors, and IT groups from Fortune 1000 companies
Only CountDown delivers thepower to master the complexity of the mobile market.
TestQuest CountDown provides the architecture
and functionality to optimize testing across:
any application or content:
any device:
any platform:
any air interface:
any network:  
Cingular, Sprint, T-Mobile, Verizon, Vodafone, O2
TestQuest的自动化测试平台 – CountDown <1>
□专门为无线和移动行业设计的自动化测试平台。集成了测试开发、测试管理与测试执行功能；支持分布式研发团队之间测试资源的开发与共享。我们提供7/24的自动化测试解决方案，以帮助无线和移动设备制造商缩短产品在市场上推出的时间。
□适用于所有类型(Windows Mobile/Symbian/Linux/Brew等开放式操作系统和专用/私有操作系统，所有硬件平台
TestQuest的自动化测试平台 – CountDown <2>
□自动测试过程基于UI(用户接口)/MMI(人机接口)实现：通过控制终端的键盘、旋钮和触摸屏来模拟测试工程师的
双手操作；通过抓取LCD屏幕显示图像进行智能OCR识别来模拟测试工程师的双眼辨识文字或图像信息。真正实现独立于任何操作系统、任何硬件平台或任何网络制式的自动测试。
□全图形化的开发环境，使得用户无需编写任何代码即可完成测试用例的开发、调试及运行。并且，开发完成的
测试用例，无需改动或稍微改动，即可移植应用到其它类型的手机或手持终端设备。
TestQuest的自动化测试平台 – CountDown <4>
CountDown的各个模块不但功能上相互独立，还可以根据用户的具体需求布置在不同的地理位置；真正实现了全球范围内团队间的协作开发。
[upload=jpg]UploadFile/2007-5/07511@52RD_{4CF1B496-4DFA-430F-A598-66BC5E31AC51}.JPG[/upload]
只有TestQuest的自动化测试技术：
全图型化的开发环境，无须编程即可生成测试用例可以测试任何类型的手机或手持终端设备可以同时连接多个终端设备进行端到端的系统测试可以真正实现测试资源跨平台的移植和重复使用可以实现整个移动产业链上不同测试团队间的开发协作


[upload=jpg]UploadFile/2007-5/07511@52RD_图片4.jpg[/upload]TestQuest自动测试系统带给手机厂商的价值
□降低了手工测试所需要的人员的招聘，培训，管理以及工资等成本
□加快测试速度，缩短测试时间，使新产品能够尽早上市赚取最大的利润
□提高测试的覆盖率和准确率，在新产品上市之前，尽可能多的发现问题， 最大程度降低因质量问题所导致的产品召回所造成的直接经济损失以及随之而来的给品牌带来的负面影响  
我们的客户
[upload=jpg]UploadFile/2007-5/07511@52RD_{AEE293C0-4FB7-4450-B320-633BF73D0CF3}.JPG[/upload]

TestQuest用户的成功案例
Verizon Wireless
–Challenge:  Automate testing of MMS and SMS/EMS functions on wireless devices for Verizon Wireless and its ecosystem
–Solution:
&#8226;Developed over 800 MMS and 400 SMS/EMS automated test cases
&#8226;Verizon and its OEMS are deploying solution to speed time to market and reduce testing costs while ensuring a quality end user experience
T-Mobile
–Challenge:  Automate manual field testing to assess network performance  
–Solution:
&#8226;Developed automated scripts to measure time to download email, download portal page and set up 2G and 3G calls
&#8226;Deploying solution in 15 locations in Germany; plan to extend functionality of scripts and expand deployment in Germany and to UK, Netherlands and Eastern Europe
Hutchison 3G
–Challenge:  Automate handset conformance and data services testing
–Solution:
&#8226;Automated testing of basic handset functionality; working in cooperation with Tata Consultancy Services (TCS)
&#8226;Automated testing of video content across a wide variety of devices to ensure quality of end user experience; working in cooperation with Wipro
&#8226;Planning to extend deployments in UK and to other locations (e.g., Italy, Hong Kong, Australia, Sweden and Austria)
Nokia
Application
Provide a test automation capability to Nokia’s S60 development and QA teams.
Problem
Eliminate the need to develop an internal tool but provide cost-effective and highly-customizable, Nokia S60 specific tooling.   
Solution
TQ and Nokia collaborated on TEM-TQ, a combination of TQ’s engine and Nokia’s scripting.  Nokia has recently evolved their solution to it’s 2nd Generation (ASTE), demonstrating continued test automation value.
Results
70 seats deployed in the past 2.5 years. Deployments accelerating as scripting completed. TQ awarded WW contract as GTI Vendor (general test infrastructure).  
TI

Application
System testing of the OMAP mobile and wireless reference designs running across all major commercial Oss
Problem
Testing required across a large number of HW and SW reference platforms supporting ALL open operating systems (Windows Mobile, CE, Symbian, Linux and Palm) and the leading closed environments
Solution
Automate a large percentage of their OS functional, HW/SW compatibility and performance tests
Results
Broad rollout within the OMAP groups
TI is designing custom HW to adapt their reference platforms to TQ Product
TI has created a TQ staff automation group to oversee the development and rollout of TQ, looking for areas to improve sharing and reusability

yumail312

lz介绍的产品能支持纯协议栈测试吗？就是说没有物理层/硬件支持，也没有应用的情况下，只验证协议栈的协议一致性，用你的产品能否解决？另外，能否单独验证物理层功能，隔离协议栈和硬件？业界确实有这种需求哦

yumail312

楼主出来答下疑啊！

cylbailey

感觉只是提供了一个Framework，至于具体下层怎么实现，还是需要自己去做的。
   是否是提供适合测试环境的脚本环境？
   是否提供开放式的软件接口？
   是否提供丰富的测试用例？

gyh_2000

是控制手机的按键和截屏幕的工具

pugu

是哦，没看明白．．

chenhuayang

脚本还是需要自己写，冠冕堂皇的说了一通，相对于传统软件就只增加了两个部分：

1、手机与PC同步功能（其实WINCE的手机可以轻松实现）

2、提供PC与手机间的接口，估计是支持目前的主流的手机芯片

nideshao

全球无线和移动设备制造商所面临的挑战

本文来自：我爱研发网(52RD.com) - R&D大本营
详细出处：http://www.52rd.com/bbs/Detail_RD.BBS_75632_32_1_1.html