Skip to content

[Swift shipping] Improve testing framework #3068

Open
@kotlarmilos

Description

@kotlarmilos

AI-driven testing bot

This bot helps discover new, real-world test cases based on the Swift SDK frameworks. The goal is to introduce an AI-driven github testing bot that identifies new real-world usage patterns based on projected APIs from Swift SDK frameworks.

There are two main features: (1) to help development, run the bot on PRs to discover new use cases introduced by the PR; (2) to instruct end-users, generate projections from provided Swift code snippet.

Functional requirements:

  • The bot shall be able to run projection tooling against all frameworks within the SDK
  • The bot shall be able to run projection tooling against a provided Swift code snippet
  • The bot shall be able to generate small real-world use cases based on provided APIs
  • The bot shall be able to run generated bindings and report results
  • The bot shall be able to report the number of newly supported types and methods per framework for a PR
  • The bot shall be able to validate proposed end-user scenarios against existing functional tests to avoid redundancy

Infrastructure

  • Add simple KPI metrics
  • Make the test runner AOT compatible and enable Native AOT
  • Standup arm64 functional and device tests using Helix
  • Configure nuget to include use mergeable libraries
  • Trim nuget package to include platform specific native libraries only
  • Add app submission tests to App Store

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions