SmokeTest测试流程

Posted houser0323

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了SmokeTest测试流程相关的知识,希望对你有一定的参考价值。

测试目的:
用于检测该版本在基本的应用场景下,基本的功能是否满足。
测试前提:
发货版本

示例:ATV9冒烟测试测试项解读
表格获取:Google ATV help官网。
Test Plan Version

1.1.2_External_and_3PL

Device/Build details

Build fingerprint(s) being tested:
Use: adb shell getprop ro.build.fingerprint
<fingerprint(s)>

Reference fingerprint of previously Approved build:
Populate this if only running the ‘Lite test‘ cases, and relying on fuller tests from previously Approved builds.
See details here:
<fingerprint(s)>

https://support.google.com/androidpartners_androidtv/answer/9020145

Area
Lite test?
Test
What to look for
Exclusions / Applicability
Does it work?
Notes
测试目的 & 操作
Remote Control
遥控器测试

Design
Verify remote control meets specification

设计要求详见蓝色链接

General navigation
Verify:

  • Remote pairing procedure works
  • Device is responsive to remote control, including after long periods of inactivity.
  • HOME & BACK buttons and DPAD navigation work

Pass
验证蓝牙配对
验证设备对遥控器有响应
home键back键和导航按键可用

Apps button
If the optional Apps button is used, ensure it opens the Apps view.
android 8.0+ only

Long press on Home
Ensure a long-press on Home button opens the Apps view (internally this may be KEYCODE_ALL_APPS, or may be a long press of KEYCODE_HOME).
Android 8.0+ only, Standard Launcher only
Pass
如果长按home键弹出选项功能启用,则验证是不是能长按显示选项

Send bug report key combination
Verify that BACK+CENTER triggers a bugreport on the device (Android 9.0 onwards).
Verify that BACK+CENTER is NOT used for any other functionality (e.g. entering pairing mode, etc.)

Pass
验证bugreport功能
两个蓝牙遥控器,一个按back另一个按center键

Additional buttons
Verify all buttons on the remote control have clear purpose.

所有遥控器上有的按钮都有明确的功能作用

Google Assistant bluetooth voice control
Verify that on press of the Voice Search Assistant button either:

  • Google Assistant is launched and functions correctly.
    or
  • The user is informed their remote is not paired and how to pair it.

Fail
验证语音键:
Google语音助手功能正常
用户在未连接蓝牙的时候按语音键会收到未连接蓝牙以及如何连接蓝牙的提示

Bootup
开机流程

Bootup branding requirements
Check bootup requirements here.

Pass
验证开机要求。开机动画开机logo等

Setup flow
开机流程

Setup flow on Wifi
Run through device Setup flow using a Wi-Fi connection (if supported)
Only if Wi-Fi supported
Pass
验证wifi

Setup flow on Ethernet
Run through device Setup flow using an Ethernet connection (if supported)
Only if Ethernet supported
Pass
验证有线以太网

2nd screen login
Verify sign-in to a Google account using the ‘Use your phone or laptop‘ option

Pass
能用手机或者笔记本登录

Smart Setup
Set up device using phone/tablet, by using the ‘Setup your TV with an Android phone or tablet‘ option. (or ‘Do you have an Android phone/tablet‘).
Only if Smart Setup is enabled
Pass
能用手机或平板登录

Tutorials
Verify all Tutorial content is appropriate for your device. Specifically Custom Launcher devices should not show the tutorial for the standard Android TV launcher
Android 8.0+ only
Pass
看一下所有导航内容是否适合你的设备。
如果是定制launcher则不能显示标准Android launcher

Landing screen after first boot
Verify user lands on the correct screen after the setup flow:

  • Retail devices must land on the Android TV launcher after first boot
  • Operator Tier devices with a Custom Launcher may land on a live TV channel, or Screen 0
  • Operator Tier devices with the Standard Launcher may land on the launcher, or TV App.

Pass
验证用户登录会在设置流程中正确的屏幕中出现
零售设备必须在首次开机登录
运营商设备,定制launcher可在live tv 或者 screen 0 登录
运营商设备,标准 launcher 可在launcher登录或者 TV app

Partner screens ahead of Google login
Verify partner logins etc. are not placed ahead of the Google login screen (except where specifically allowed for Operator Tier devices: https://support.google.com/androidpartners_androidtv/answer/6189435).

Pass
合作商登录界面不能再Google登陆之前

Setup flow robustness
Conduct robustness testing for Setup flow to ensure user can move back and forth between screens (especially to/from partner-specific extensions), without getting stuck on a given page (or blank screen). Ensure pressing back on each screen works as expected.

Pass
设置稳健性。在任何屏幕之间来回移动,back都可用。

Launcher Placement
主页布置、布局摆放

App placement on first boot
Verify out-of-the-box app placement requirements are met, according to https://support.google.com/androidpartners_androidtv/answer/6189435. For Android 8.0+ devices be sure to check the Apps view as well as the Home Screen Favorites row.
Standard Launcher devices only
Pass
验证是否满足现成的应用程序放置要求,见链接

Channel placement on first boot
Verify out-of-the-box Home screen Channel placement requirements are met, according to https://support.google.com/androidpartners_androidtv/answer/6189435
Android 8.0+ only, Standard Launcher
Pass

YouTube
Yes
Play videos
Videos can be played. Check SD and HD (and 4K if supported). Check A/V sync. Check different aspect ratio videos are displayed without stretching. Check live streaming videos are played correctly. Check signing in to YouTube.

Pass
可以播放视频。检查SD和HD(以及4K,如果支持)。检查A/V同步。检查不同的纵横比视频是否显示而不拉伸。检查直播视频是否正确播放。检查登录YouTube

Yes
General usage together with launcher interaction, recommendations, power states, etc.
Verify:

  • YouTube Recommendations/Channel shown in launcher (Home screen) (Standard Launcher only).
  • YouTube works after power off/on

Pass
验证:
-在Launcher(主屏幕)中显示的YouTube推荐/频道(仅限标准Launcher)。
-YouTube在关机/开机后工作

Run full Android TV YouTube test pack
Full YouTube tests are only required on certain builds (first for a device, major version upgrades). If relying on full YouTube tests from a previously Approved build, add that reference build fingerprint in the Notes column. For more details, see:

Pass
完整的YouTube测试仅在某些版本上需要(首先是设备的主要版本升级)。如果依赖于先前批准的版本的完整YouTube测试,请在Notes列中添加该参考版本指纹。有关详细信息见链接
这个是另外一个测试,比较重要,测试正常的YouTube能不能用。

https://support.google.com/androidpartners_androidtv/answer/9020145

Play Movies
Yes
Play Trailer
Verify trailer can be played. Check A/V sync.

Pass
验证是否可以播放预告片。检查A/V同步。

Yes
Play DRMd movie
Verify DRM protected movies (paid content) by purchasing content, ensuring HD and UHD playback, and correct A/V sync for stereo and surround content.
UHD content n/a for FHD devices
需要钱
通过购买内容、确保高清和超高清播放以及校正立体声和环绕内容的A/V同步来验证受DRM保护的电影(付费内容)。
测试部测

Yes
General usage together with launcher interaction, recommendations, power states, etc.
Verify:

  • Play Movies Recommendations/Channel shown in launcher (Standard Launcher only).
  • Movie pauses/resumes successfully when using another app.
  • Play Movies works after power off/on
  • Movies can be purchased/rented.
  • HD, UHD content can be purchased/played (whitelisting check)
    UHD content n/a for FHD devices
    Pass
    验证:
    -播放在启动程序中显示的电影推荐/频道(仅限标准启动程序)。
    -使用其他应用程序时,电影暂停/恢复成功。
    -关机/开机后播放电影
    -电影可以购买/租赁。
    -可购买/播放高清、超高清内容(白名单检查)

Play Music
Yes
Music Playback
Verify Music playback works

Pass
音乐可回放

Yes
General usage together with launcher interaction, recommendations, power states, etc.
Verify:

  • Music continues when switching to Home (if supported by Launcher)
  • Music stops when powered off
  • Music pauses/resumes successfully when using another app.

Pass
验证:
-切换到主页时音乐继续(如果启动程序支持)
-关闭电源后音乐停止
-使用其他应用程序时,音乐暂停/恢复成功。

Play Games
Yes
General usage
Verify account login, games can be launched.

Pass
游戏账号能登陆,游戏能运行

Search/Assistant
Note: The Google Search app ("Katniss") had a major User Experience change in app version 3.x, which affects the required tests. Be sure to check the version in Settings -> Apps -> Google,
and use the appropriate Smoke Test section below. Katniss 3.x is required on Android 8.0 onwards, but is also used on selected Android 6 or Android 7 devices, so it‘s important to check.

Voice Search
语音搜索
(Katniss 2.x)
Yes
Voice Search with remote button (while on Home screen)
Verify results come from:

Voice Search selected in launcher
Use D-pad to select Voice Search icon, then OK to activate. Verify voice search works.
Note: This is ensuring the microphone can be activated from the Android TV device, without using the dedicated Mic button on the Remote control
Katniss 2.x only
Pass
使用D- PAD选择语音搜索图标,然后OK激活。验证语音搜索工作。
注意:这是确保麦克风可以从Android TV设备激活,而不使用遥控器上的专用MIC按钮。

Voice search in Play Store
Verify searches Play content
Katniss 2.x only
Pass
Play Store语音搜索

Yes
Voice search in Play Movies
Verify searches Play Movies content
Katniss 2.x only
Pass
Google play movies 语音搜索

Yes
Voice search in YouTube
Verify searches YouTube content
Katniss 2.x only
Pass
YouTube 语音搜索

Voice search in Play Music
Verify searches Music content
Katniss 2.x only
Pass
Google Play Music 语音搜索

Yes
Voice search latency
Verify acceptable voice search latency
Katniss 2.x only
Pass
语音反应时间能接受

Search/Assistant
语音搜索助手 (Katniss 3.x)
Yes
Voice Search with remote button
Verify results come from:

  • YouTube.
  • Play Movies (depends on country)
  • Knowledge (depends on country). Search by actor‘s name.
  • 3rd Party App Installed on device where App Supports Assitant Results.
    Katniss 3.x only
    Pass
    验证结果来自:
  • YouTube。
    -播放电影(取决于国家)
    -知识(取决于国家)。按演员的名字搜索。
    第三方应用程序安装在应用程序支持辅助结果的设备上。

Yes
Voice Search selected in launcher
Use D-pad to select Voice Search ( / Assistant) icon (if present), then OK to activate. Verify voice works.
Note: This is ensuring the microphone can be activated from the Android TV device, without using the dedicated Mic button on the Remote control
Katniss 3.x only
Pass
使用D- PAD选择语音搜索(/助理)图标(如果存在),然后OK激活。验证语音工作。
注意:这是确保麦克风可以从Android TV设备激活,而不使用遥控器上的专用MIC按钮。

Voice search in Play Store, with Remote button
Verify Google‘s search user experience is displayed, with Play Store results prioritised. e.g. search for app names
Katniss 3.x only
Pass
验证谷歌的搜索用户体验是否显示,与播放存储结果区分优先。例如,搜索应用程序名称

Voice search in Play Store, using on-screen search icon
Verify Google‘s Play Store search user experience is displayed, showing Play Store content exclusively
Katniss 3.x only
Pass
验证谷歌游戏店搜索用户体验显示,优先显示游戏商店内容

Yes
Voice search in Play Movies, with Remote button
Verify Google‘s search user experience is displayed, with Play Movies results prioritised. e.g. search for movies genres
Katniss 3.x only
Pass
验证Google的搜索用户体验,并优先显示播放电影的结果。

Yes
Voice search in Play Movies, using on-screen search icon
Verify Google‘s Play Movies search user experience is displayed, showing Play Movies content exclusively
Katniss 3.x only
Pass
点屏幕上搜索按钮,只显示电影内容

Voice search in Play Music, with Remote button
Verify Google‘s search user experience is displayed, with Play Music results prioritised. e.g. search for music artists
Katniss 3.x only
Pass
验证Google的搜索用户体验,并优先显示音乐的结果。

Voice search in Play Music, using on-screen search icon
Verify Google‘s Play Music search user experience is displayed, showing Play Music content exclusively
Katniss 3.x only
Pass
点屏幕上搜索按钮,只显示音乐内容

Yes
Voice search in YouTube, with Remote button
Verify Google‘s search user experience is displayed, with YouTube results prioritised.
Katniss 3.x only
Pass
验证Google的搜索用户体验,并优先显示播放youtube的结果。

Yes
Voice search in YouTube, using on-screen search icon
Verify Google‘s YouTube search user experience is displayed, showing YouTube content exclusively
Katniss 3.x only
Pass
点屏幕上搜索按钮,只显示youtube内容

Yes
Voice search over Video playback - YouTube
Activate voice search while playing a 4K (if supported) YouTube video. Verify that voice search works and video playback is not interrupted.
Katniss 3.x only
Pass
YouTube中激活语音搜索,同时播放4K(如果支持)YouTube视频。验证语音搜索是否工作,视频播放不中断。

Yes
Voice search over Video playback - partner TV app
Activate voice search while playing live content in the TV app (if supported - otherwise VoD). Verify that voice search works and video playback is not interrupted.
Katniss 3.x only
Pass
合作商 TV app中激活语音搜索,同时播放4K(如果支持)YouTube视频。验证语音搜索是否工作,视频播放不中断。

Yes
Consecutive queries
e.g. Action Movies ... Play the third one.
Note: this is checking handling of the Mic buttons, and (for Android 7.x) confirming specific patches are in place.
Katniss 3.x only
Pass
连续地语音搜索

Yes
Voice search latency
Verify acceptable voice search latency
Katniss 3.x only
Pass
语音搜索延时可接受

Assistant use-cases
Note: To follow
Katniss 3.x only

Keyboard search
键盘搜索
Yes
Keyboard search in launcher
If Launcher has a keyboard search affordance, select using dpad and verify keyboard Search UI is used.

Pass
如果launcher具有键盘搜索提供功能,则使用DPAD选择并验证键盘搜索UI。

Text search in GTVS apps (e.g. YouTube)
Verify pressing right D-pad brings up virtual keyboard, and can search by typing.

Pass
在gtvs 应用中调用软键盘,打字搜索

Voice actions
语音动作反应

Verify Voice actions with standard remote and companion app
Test the voice actions listed here: https://support.google.com/androidpartners_androidtv/answer/6188867
If the device has a partner live TV App, voice actions should control that app (although note it‘s the partner‘s choice whether to implement the Voice Action support).
Otherwise Voice Actions can be tested with Live Channels (install from Play Store if necessary).
Switching inputs will apply to panel TVs only (not set-top box)
吴职钦
Pass
如果设备具有合作伙伴直播电视应用程序,则语音操作应控制该应用程序(尽管请注意,是否实施语音操作支持是合作伙伴的选择)。
否则,可以使用实时通道测试语音操作(如有必要,从Play Store安装)。
开关输入仅适用于面板电视(非机顶盒)
见链接

Companion app
合作app
Yes
Pairing ATV Remote via network
Verify can pair ATV Remote. Toast should show connection status. Download the phone app from https://play.google.com/store/apps/details?id=com.google.android.tv.remote

Pass
手机或者平板下载 Atv remote app,机顶盒与手机在同一网段内,验证app可用

Pairing ATV Remote via Bluetooth
Verify can pair ATV Remote. Toast should show connection status. Download the phone app from https://play.google.com/store/apps/details?id=com.google.android.tv.remote

Pass
手机关闭任何网络蓝牙连接后,蓝牙连接,app可用

Yes
Navigation with ATV Remote app
Verify navigation, ensure latency is ok.

Pass
导航键可用

Yes
Voice search with ATV Remote app
Verify phone mic is used when voice search is activated from Android TV Remote app.

Pass
语音搜索可用

Alternating voice search with companion app and standard remote (if standard remote supports voice)
Verify that you can alternate searching with Remote Control and ATV Remote app, and that correct mic is enabled for each.
Note: This is ensuring support for switching between mics is in place. See https://support.google.com/androidpartners_androidtv/answer/6211869?hl=en&ref_topic=6212198

Pass
验证是否可以使用遥控器和ATV遥控app程序交替搜索,

Verify ATV Remote app Mic key mapping
[Katniss 3.x only] Press the ATV Remote app‘s Mic button when within the YouTube app, and ensure Google search/Assistant is launched, rather than YouTube‘s in-app search.
Note: This is verifying that the generic keymap is correctly mapping to ASSIST rather than SEARCH. See
Katniss 3.x only
Pass
在YouTube应用程序中按下ATV远程应用程序的麦克风按钮,并确保启动Google Search/Assistant,而不是YouTube的应用程序内搜索。
注意:这将验证通用键映射是否正确,是帮助而不是搜索

Accessories
连接

Pair game controller (Nexus Player)
Use Settings -> Remote & accessories -> Add accessory. Ensure successfully paired.

Pass
能蓝牙连接游戏控制器(例如蓝牙游戏手柄)

Play games with game controller
Examples: Crossy Road, Asphalt 8

Fail
Asphalt 8玩不了,第三方盒子也玩不了

Partner Live TV app
合作商直播app
Yes
Launch Live TV app and view and navigate available TV channels
Basic test of partner TV service. Note: This depends on access to required service, and may not be possible in all locations.

Pass
合作伙伴电视服务的基本测试。注意:这取决于对所需服务的访问,可能有地理位置限制

Yes
Activate Launcher from Live TV app
Press Android Home key, and ensure launcher is displayed promptly

Pass
live tv 中按home键确认能回到launcher

Search Live TV app content with Remote Control button
Check partner content is searchable as intended: If Katniss 3.x is used, ensure Google handles the Search button, TV App results are provided (if implemented), and are correctly prioritised.

Pass
检查合作伙伴内容是否可以按预期进行搜索:如果使用katnis 3.x,请确保Google处理搜索按钮,提供电视应用程序结果(如果已实现),并正确区分优先级。

Ensure GTVS apps are not included in Live TV app
Ensure GTVS apps are not included as launchable links in the Live TV App (example: a YouTube app icon to launch the YouTube app), unless the device also has a Custom Launcher. Details in the ‘TV App‘ section here: https://support.google.com/androidpartners_androidtv/answer/6189435.
Note: Deep links to specific content in GTVS apps are allowed (example: to a specific YouTube video).
Standard Launcher devices only
Pass
确保GTV应用程序不作为可启动链接包含在直播电视应用程序中(例如:用于启动YouTube应用程序的YouTube应用程序图标),除非该设备还具有自定义启动程序。详情请参见“电视应用”部分:https://support.google.com/androidpartners_androidtv/answer/6189435
注意:允许深入链接到GTV应用程序中的特定内容(例如:到特定YouTube视频)。

Ensure Live TV app publishes at least one Channel to Home Screen
Ensure [non-operator] TV Apps publish at least one row of content ("Channel") onto the Home Screen, filling the row, and included in the out-of-the-box Home Screen channels list.
Ref: https://support.google.com/androidpartners_androidtv/answer/6189435
Not required for Operator Tier devices
Pass
确保[非运营商]电视应用程序将至少一行内容(“频道”)发布到主屏幕上,填充该行,并包含在开箱即用的主屏幕频道列表中。

Third-party inputs
第三方输入

Install Live Channels and 3rd party inputs
Install Live Channels (if not already preloaded).
Install 3rd party input - either:

Pass
安装 Live Channels(如果尚未预加载)。
安装第三方输入-要么:
-示例输入(https://github.com/googlesamples/androidtv sample inputs),或
Haystack TV
验证是否可以在Live Channels应用程序中设置和查看第三方输入的频道

Custom Launchers
定制launcher

Verify against Custom Launcher specification
Verify specification requirements in https://support.google.com/androidpartners_androidtv/answer/7489412
Use the test guidance in https://support.google.com/androidpartners_androidtv/answer/7544330
Note: More comprehensive steps are in progress
Custom Launcher devices only
无需测试
定制launcher的设备需要测试。见链接

Cast
投屏功能

See the Cast Testing documentation for detailed steps.
Test Cast actions see here.

Yes
Screen
Verify you can mirror the screen from an Android phone device

Pass
能用手机投屏
手机或者平板安装Google play,下载Google的一些apk,与待测设备同一网段
Yes
YouTube - free content
Verify you can Cast free content from YouTube. Verify A/V sync
Note: YouTube uses a different connection mechanism from other apps, so it‘s important to test a variety of apps

Pass
YouTube免费内容投屏

Yes
YouTube - paid content
Verify you can Cast paid content from YouTube. Verify A/V sync
Note: YouTube uses a different connection mechanism from other apps, so it‘s important to test a variety of apps

Pass
YouTube付费内容投屏

Yes
Play Movies (Widevine)
Verify trailers and DRM‘d content (SD and HD). Verify A/V sync.

Pass
验证付费内容预告片投屏

Photos
Verify Casting from the Google Photos app

Pass
Google Photos app投屏

Play Ready protected content
Verify PlayReady protected content works. Verify A/V sync. Contact your Technical Account Manager for example PlayReady-protected services in your geography

Pass
受保护内容投屏

Play Music
Verify Casting from the Google Play Music app

Pass
Google Play Music app投屏

Chrome tab
Verify Casting a Chrome tab.
Note: This test is ensuring necessary whitelisting is in place

Pass
chrome浏览器投屏。同一网段的pc端chrome浏览器--->>右上角···--->>chrome cast

Third-party apps
For non-Google apps relevant to your geography, please check with your Technical Account Manager.

付费项目之外的pass
第三方app测试,见链接

Yes
Casting interactions with launcher etc.
Verify switching from Cast to other use-cases:

  • press Home while Casting, and ensure launcher opens and Casting stops.
  • verify switching to other built-in apps with dedicated Remote Control buttons (such as the live TV service).

Pass
投屏中干别的能正常切换

Standby etc
待机
Yes
Dreams
Dreams should activate after period of inactivity. Verify device resumes correctly after long and short periods of Dreams.

Pass
流应该在一段时间的不活动后激活。验证设备在长时间和短时间的流后是否正确恢复。

Yes
Wake on cast
Verify wake-on-cast works when device is in standby. Verify after long periods (e.g. >1 day).

Pass
当设备处于待机状态时,验证Wake-on-Cast是否工作。长时间(如1天以上)后进行验证

Yes
Power off/on with remote
Verify that device wakes up from remote, including after >1 day.

Pass
待机一天后唤醒

Audio
音频
Yes
Audio output
Verify audio output.
For panel TVs or other devices with built-in speakers, this means verifying the audio coming from the built in speakers while operating the device.
For STBs or other devices without built-in speakers, this means verifying the audio coming from an external device (example: AVR, panel TV) connected via HDMI.

Pass
验证音频输出。
对于带有内置扬声器的平板电视或其他设备,这意味着在操作设备时验证内置扬声器的音频。
对于没有内置扬声器的机顶盒或其他设备,这意味着验证来自通过HDMI连接的外部设备(例如:AVR、平板电视)的音频。

Yes
Volume control
Verify volume control works to increase or decrease volume output by the device - or the connected audio output device via HDMI-CEC (if supported by remote control), including mute.
n/a for fixed volume devices
Pass
验证音量控制是否能够通过HDMI-CEC(如果遥控器支持)增加或减少设备或连接的音频输出设备的音量输出,包括静音。

Volume alignment
Verify that volume is consistent across use-cases (specifically, ensure Live TV volume aligns with other apps such as YouTube)
n/a for fixed volume devices
Pass
验证不同用例之间的音量是否一致(特别是,确保直播电视音量与YouTube等其他应用程序保持一致)

HDMI CEC
CEC 功能

Navigation from connected TV
(STB and OTT): Ensure device can be controlled using TV remote control for D-pad navigation, etc.
n/a for panel TVs
Pass
STB和OTT):确保设备可以使用电视遥控器控制D-PAD导航等。

Control of connected STB/OTT
(TV only): Ensure connected devices can be controlled using TV remote for D-pad navigation etc.
Panel TVs only
Pass
仅限电视):确保连接的设备可以使用电视遥控器控制D-Pad导航等。

HDMI ARC

Connect TV to Audio Receiver
Ensure audio routes to AVR when connected via ARC supported HDMI input, even when using other input sources (HDMI1, HDMI2, etc)
Panel TVs only
不测

Play Netflix with 5.1 Audio
Ensure audio pass through to AVR.
Panel TVs only
没netflix,不用测试

Component Input
分量输入

Connect a device via the component input
Make sure that component input works.
Panel TVs with component input(s) only

不支持分量输入

Optical Audio Out
光口

Connect TV to Audio Receiver via SPDIF
Test optical out
Devices with optical output only
看有没光口,没有的话就不用测试
无光口,不测

Restricted Profile
(If device supports restricted profile)
限制模式
Yes
Enable restricted profile
Ensure a restricted profile can be configured and enabled: Settings -> Personal -> Security & restrictions -> Restricted Profile -> Settings...
Only if Restricted Profile is supported
不用测试,不支持restricted profile

Yes
Verify live TV app within restricted profile, if supported
If the TV App configuration allows inclusion in a restricted profile, verify this works correctly.
Only if Restricted Profile is supported

配置控制的限制模式启用

Yes
Disable restricted profile
Ensure a restricted profile can be exited. Verify device functionality afterwards, in particular built in apps/services such as live TV.
Only if Restricted Profile is supported

配置控制的限制模式关闭

Device Properties
设备属性

Client ID: Check clientidbase is correctly set
Use adb shell getprop ro.com.google.clientidbase. Confirm clientidbase with your Technical Account Manager.

Pass
和技术专家确认该属性adb shell getprop ro.com.google.clientidbase

Operator Tier feature flags
Verify feature flags are correctly set per https://support.google.com/androidpartners_androidtv/answer/7642046
Note Operator Tier flag is not dependent on having a Custom Launcher.
Use: adb shell pm list features | grep "com.google.android.tv"
Android 8.0+ only
Pass
确认feature正常
adb shell pm list features | grep "com.google.android.tv"

Global Assist Triggering feature
Verify GLOBAL_ASSIST_TRIGGERING feature is correctly set, if Katniss 3.x is used. See details at https://support.google.com/androidpartners_androidtv/answer/7539488
Use: adb shell pm list features | grep "GLOBAL_ASSIST_TRIGGERING"

Pass
确认feature GLOBAL_ASSIST_TRIGGERING
adb shell pm list features | grep "GLOBAL_ASSIST_TRIGGERING"

Check unique serial number is correctly set
This should be visible with lsusb or adb shell getprop ro.serialno

Pass

Games: examples
示例游戏
Yes
General Game testing
Broadly test the device with a range of games from the Play Store. Examples to get started:

  • Zen Pinball
  • Redball 4
  • Shark Evolution
  • Asphalt
  • Beach buggy racing
  • Minion Rush

Fail
盒子安装游戏,进行试玩,确认可正常游戏

Apps: examples
示例app
Yes
General App testing
Broadly test the device with a range of third-party apps from the Play Store, tailored to the target geography. Examples to get started:

  • TED
  • NHK WORLD TV
  • Tune In
  • Bloomberg TV
  • MyRadar
  • Twitch

Pass
盒子安装这些apk,确认能正常使用

以上是关于SmokeTest测试流程的主要内容,如果未能解决你的问题,请参考以下文章

.NET 程序集单元测试工具 SmokeTest 应用指南

.NET 程序集单元测试工具 SmokeTest 应用指南

2021-10-22

测试流程规范

软件测试的流程是啥?

软件测试流程图!转行互联网职场必备!