Android 14 CTS Release Notes

This page includes the key CTS changes introduced in Android 14.

CTS features

Android 14 includes new and updated documentation for the following CTS features.

AreaFeaturesDescriptionAdded/Updated
Test HighlightsAdd utility functions to run as carrier serviceThis change introduces new utility functions in CarrierPrivilegeUtils to allow CTS to run as a carrier service (implicitly with carrier privileges) and improve the testability for many carrier APIs and connectivity classes.Updated
Test moduleAdd multi-device CTS tests for BluetoothThis feature allows advertisements to expose only specified GATT services, allowing for better privacy when continuously advertising in connectable mode.Added
Test moduleAdd multi-device CTS tests for UWB ranging distance accuracyAdd new test cases for UWB ranging distance measurement accuracy to enforce the UWB CDD requirement.Added
Test moduleAdd CtsDevicePolicySimTestCases to CTS SIM test planThe test case was updated to require a valid SIM as a part of test setup.Added
Test moduleAdded UWB multi-device CTS test suiteAdded a new UWB multi-device CTS test suite which uses 2 UWB enabled android devices to verify various UWB functionalities.Added
Test moduleIncreased test cases in dEQP moduleUpdated dEQP branch for Android 14 CTS to use vulkan-cts-1.3.5 (instead of 1.3.1). Many new tests are added as this update brings many new tests for the new Vulkan features such as dynamic rendering.Updated
Test SetupIncrease heap size to 16GBIncreased heap memory size to help execute CTS tests that consume greater memory.Updated
Test SetupUpgrade RAM to 128GB and HDD to 256GBUpgrade host system memory to handle added Java heap space requirements.Updated

CTS Verifier features

Android 14 includes new and updated documentation for the following CTS Verifier features.

AreaFeaturesDescriptionAdded/Updated
Test SetupUpdate required peripherals for Dynamic Sensor TestUpdate CTS Verifier test guidance page to include updated pheripherals and instructions for the dynamic sensor tests.Updated
Test SetupImprove Camera ITS to support Foldable DevicesSupport foldable device testing in Camera ITS. Made changes in ItsService side to determine the available physical cameras with each fold/open state.Updated
CTS-V test classWi-Fi Aware pairingWi-Fi aware pairing provide a encrypt and fast re-auth way for peer-to-peer communication throw Wifi aware. Add test in CTS-V as other multi devices tests for Aware. The test needs both devices support this feature.Added
CTS-V test classTest activities for home Controls embedded panelStarting in Android 14, a new API is provided so apps can use an embedded activity (in the SystemUI controls space) instead of passing the information through the Controls API. New test activities added to enforce the API behavior.Added
CTS-V test classTests for Presence requirements (BLE & NAN/Wi-Fi Ranging)To ensure that users' smart devices work well together, it's critical that all devices in the Android ecosystem can determine the relative proximity between devices. Android U introduces presence calibration requirements that outline the acceptable performance of available radio technologies such as UWB, Wi-Fi, and BLE that are used to determine proximity.Added
CTS-V test classCTS Verifier for AAudio DisconnectTest to verify that AAudio should disconnect a stream when the stream device is unplugged.Added
CTS-V test classCTS Verifier Screenshot Work Profile testAdd new test cases to enforce CDD requirement 3.9.2/C-1-10. User will be instructed to take a screenshot. ContentObserver detects URI of the screenshot saved and displays the result. User must visually confirm the image, which does not contain other apps or SystemUI (status bar, etc).Added
Test HighlightsCTS Verifier Capture Content for Notes APIs test.Add new test activity to enforce Notes APIs, which are linked to system note-taking integrations in SysUI. The test can be skipped if the NOTES role isn't enabled. See Capture Content for Notes Tests for more details.Added
Test SetupExecute adb command to turn on the screen automatically when the tests finishStarting in Android 14, android.permission.TURN_SCREEN_ON permission has been added to allow the screen to be turn on after the test is completed. To enable the feature, user will need to execute the adb command adb shell appops set com.android.cts.verifier TURN_SCREEN_ON 0 in the setup step.Updated
Test SetupUpdate Rotation Vector testing instructionUsers should download OpenCV-3.0.0-android-sdk.zip and install the OpenCV Manager on the Android device being tested. Load the APK on the device from a computer using the adb install command with the --bypass-low-target-sdk-block option. For devices running Android 13 or lower, this --bypass-low-target-sdk-block option isn't necessary. For more information, see Install an app.Updated
Test SetupAdd adb install notes regarding OpenCV APKDue to a new security feature that was introduced in Android 14, the adb command --bypass-low-target-sdk-block must be added every time when installing the Open CV APK. See Rotation vector CV crosscheck for more information.Added

CTS modules

The number of test modules and test cases are as follows:

  • ~ 1151 modules depending on the devices
  • ~ 4.4M test cases over 2 ABIs

In Android 14, a total of 136 new modules are added and a total of 19 modules are removed. See the following tables for more information.

New modules

Added test module nameABIsInstant App test
AndroidTest_MultiUserarm64-v8a
art-run-test-018-stack-overflowarm64-v8a
art_standalone_dex2oat_cts_testsarm64-v8a
CtsAdIdEndToEndTestarm64-v8a
CtsAdServicesDebuggableDeviceTestCasesarm64-v8a
CtsAdServicesEndToEndTestMeasurementarm64-v8a
CtsAdServicesEndToEndTestsarm64-v8a
CtsAdServicesHostTestsarm64-v8a
CtsAdServicesMddTestsarm64-v8a
CtsAdServicesNotInAllowListEndToEndTestsarm64-v8a
CtsAdServicesPermissionsAppOptOutEndToEndTestsarm64-v8a
CtsAdServicesPermissionsNoPermEndToEndTestsarm64-v8a
CtsAdServicesPermissionsValidEndToEndTestsarm64-v8a
CtsAdServicesTopicsAppUpdateTestsarm64-v8a
CtsAdServicesTopicsConnectionTestsarm64-v8a
CtsAppCloningDeviceTestCasesarm64-v8a
CtsAppCloningMediaProviderHostTestarm64-v8a
CtsAppCloningMediaProviderHostTest[instant]arm64-v8aYes
CtsAppFgsTestCasesarm64-v8a
CtsAppFgsTestCases[instant]arm64-v8aYes
CtsAppSetIdEndToEndTestarm64-v8a
CtsAttributionSourceTestCasesarm64-v8a
CtsAttributionSourceTestCases[instant]arm64-v8aYes
CtsBatteryHealthTestCasesarm64-v8a
CtsBiometricsHostTestCasesarm64-v8a
CtsBluetoothMultiDevicesTestCasesarm64-v8a
CtsBroadcastRadioTestCasesarm64-v8a
CtsBroadcastTestCasesarm64-v8a
CtsCompanionDeviceManagerMultiProcessTestCasesarm64-v8a
CtsCompilationTestCasesarm64-v8a
CtsContentProviderTestsWithoutVisibilityarm64-v8a
CtsContentProviderTestsWithVisibilityarm64-v8a
CtsCredentialManagerTestCasesarm64-v8a
CtsCurrentApiSignatureTestCases[instant]arm64-v8aYes
CtsDeviceLockTestCasesarm64-v8a
CtsDevicePolicySimTestCasesarm64-v8a
CtsDevicePolicySimTestCases[run-on-clone-profile]arm64-v8a
CtsDevicePolicySimTestCases[run-on-secondary-user]arm64-v8a
CtsDevicePolicySimTestCases[run-on-work-profile]arm64-v8a
CtsDevicePolicyTestCases[run-on-clone-profile]arm64-v8a
CtsDomainVerificationDeviceMultiUserTestCases[run-on-clone-profile]arm64-v8a
CtsGrammaticalInflectionHostTestCasesarm64-v8a
CtsGrammaticalInflectionTestCasesarm64-v8a
CtsHealthConnectControllerTestCasesarm64-v8a
CtsHealthConnectHostSideDeviceTestCasesarm64-v8a
CtsHealthConnectHostTestCasesarm64-v8a
CtsHealthFitnessDeviceTestCasesarm64-v8a
CtsHealthFitnessDeviceTestCasesNoPermissionarm64-v8a
CtsHealthFitnessDeviceTestCasesNoPermission[instant]arm64-v8aYes
CtsHibernationTestCasesarm64-v8a
CtsJvmtiRunTest1940HostTestCasesarm64-v8a
CtsJvmtiRunTest911HostTestCasesarm64-v8a
CtsJvmtiRunTest912HostTestCasesarm64-v8a
CtsJvmtiRunTest913HostTestCasesarm64-v8a
CtsJvmtiRunTest988HostTestCasesarm64-v8a
CtsLaunchNonExportedComponentsTestCasesarm64-v8a
CtsLocalVoiceInteractionarm64-v8a
CtsLocalVoiceInteraction[instant]arm64-v8aYes
CtsMediaBetterTogetherTestCasesarm64-v8a
CtsMediaBetterTogetherTestCases[instant]arm64-v8aYes
CtsMediaBetterTogetherTestCases[run-on-clone-profile]arm64-v8a
CtsMediaBetterTogetherTestCases[run-on-secondary-user]arm64-v8a
CtsMediaBetterTogetherTestCases[run-on-work-profile]arm64-v8a
CtsMediaProjectionTestCasesarm64-v8a
CtsMediaProjectionTestCases[instant]arm64-v8aYes
CtsMicrodroidDisabledTestCasesarm64-v8a
CtsMultiUserTestCases[run-on-clone-profile]arm64-v8a
CtsNativeResourcesTestCasesarm64-v8a
CtsNativeResourcesTestCases[instant]arm64-v8aYes
CtsNetHttpTestCasesarm64-v8a
CtsNetTestCasesMaxTargetSdk30arm64-v8a
CtsNetTestCasesMaxTargetSdk30[instant]arm64-v8aYes
CtsNetTestCasesMaxTargetSdk33arm64-v8a
CtsNetTestCasesMaxTargetSdk33[instant]arm64-v8aYes
CtsNotificationTestCasesarm64-v8a
CtsOsTestCases[run-on-clone-profile]arm64-v8a
CtsPackageInstallTestCases[run-on-clone-profile]arm64-v8a
CtsPackageInstallTestCases[run-on-secondary-user]arm64-v8a
CtsPackageInstallTestCases[run-on-work-profile]arm64-v8a
CtsPackageSchemeTestsWithoutVisibilityarm64-v8a
CtsPackageSchemeTestsWithVisibilityarm64-v8a
CtsPerfettoReporterTestCasesarm64-v8a
CtsPermissionMultiUserTestCasesarm64-v8a
CtsPermissionMultiUserTestCases[run-on-clone-profile]arm64-v8a
CtsPermissionMultiUserTestCases[run-on-secondary-user]arm64-v8a
CtsPermissionMultiUserTestCases[run-on-work-profile]arm64-v8a
CtsPermissionPolicyTestCasesarm64-v8a
CtsPermissionPolicyTestCases[instant]arm64-v8aYes
CtsPhotoPickerTest[run-on-clone-profile]arm64-v8a
CtsSandboxedAdIdManagerTestsarm64-v8a
CtsSandboxedAppSetIdManagerTestsarm64-v8a
CtsSandboxedFledgeManagerTestsarm64-v8a
CtsSandboxedMeasurementManagerTestsarm64-v8a
CtsSandboxedTopicsManagerTestsarm64-v8a
CtsSdkSandboxHostSideTestsarm64-v8a
CtsSdkSandboxInprocessTestsarm64-v8a
CtsSdkSandboxWebkitTestCasesarm64-v8a
CtsShortFgsTestCasesarm64-v8a
CtsShortFgsTestCases[instant]arm64-v8aYes
CtsSurfaceControlTestsarm64-v8a
CtsTareTestCasesarm64-v8a
CtsTelecomHostCasesarm64-v8a
CtsThreadLocalRandomHostTestarm64-v8a
CtsVideoCodecTestCasesarm64-v8a
CtsVideoEncodingQualityHostTestCasesarm64-v8a
CtsVideoEncodingQualityHostTestCases[instant]arm64-v8aYes
CtsVoiceInteractionHostTestCasesarm64-v8a
CtsWallpaperSdk33TestCasesarm64-v8a
CtsWallpaperSdk33TestCases[instant]arm64-v8aYes
CtsWallpaperTestCasesarm64-v8a
CtsWallpaperTestCases[instant]arm64-v8aYes
CtsWearableSensingServiceTestCasesarm64-v8a
CtsWindowManagerBackgroundActivityTestCasesarm64-v8a
CtsWrapHwasanTestCasesarm64-v8a
SdkSandboxManagerDisabledTestsarm64-v8a
SdkSandboxManagerTestsarm64-v8a
art-run-test-018-stack-overflowarmeabi-v7a
art_standalone_dex2oat_cts_testsarmeabi-v7a
CtsBiometricsHostTestCasesarmeabi-v7a
CtsBroadcastRadioTestCasesarmeabi-v7a
CtsCompilationTestCasesarmeabi-v7a
CtsDevicePolicySimTestCasesarmeabi-v7a
CtsJvmtiRunTest1940HostTestCasesarmeabi-v7a
CtsJvmtiRunTest911HostTestCasesarmeabi-v7a
CtsJvmtiRunTest912HostTestCasesarmeabi-v7a
CtsJvmtiRunTest913HostTestCasesarmeabi-v7a
CtsJvmtiRunTest988HostTestCasesarmeabi-v7a
CtsMediaBetterTogetherTestCasesarmeabi-v7a
CtsMediaProjectionTestCasesarmeabi-v7a
CtsNativeResourcesTestCasesarmeabi-v7a
CtsNetHttpTestCasesarmeabi-v7a
CtsSurfaceControlTestsarmeabi-v7a
CtsVideoCodecTestCasesarmeabi-v7a
CtsVideoEncodingQualityHostTestCasesarmeabi-v7a
CtsWindowManagerDeviceTestCasesarmeabi-v7a
CtsWrapHwasanTestCasesarmeabi-v7a

Removed modules

Deleted Test module nameABIsInstant App Test
CtsActivityManagerBackgroundActivityTestCasesarm64-v8a
CtsAdServicesDeviceTestCases[instant]arm64-v8aYes
CtsCameraApi31TestCasesarm64-v8a
CtsHostTzDataTestsarm64-v8a
CtsIncidentHostTestCasesarm64-v8a
CtsIncidentHostTestCases[instant]arm64-v8aYes
CtsOnDevicePersonalizationTestCasesarm64-v8a
CtsOnDevicePersonalizationTestCases[instant]arm64-v8aYes
CtsPermission2TestCasesarm64-v8a
CtsPermission2TestCases[instant]arm64-v8aYes
CtsPermission4TestCasesarm64-v8a
CtsPermission5TestCasesarm64-v8a
CtsPermission5TestCases[instant]arm64-v8aYes
CtsSystemUiHostTestCases[instant]arm64-v8aYes
CtsVirtualDevicesTestCases[instant]arm64-v8aYes
CtsActivityManagerBackgroundActivityTestCasesarmeabi-v7a
CtsCameraApi31TestCasesarmeabi-v7a
CtsGwpAsanTestCasesarmeabi-v7a
CtsIncidentHostTestCasesarmeabi-v7a