Run AWS Lambda tests locally (#3988)

Test Sentry AWS Lambda integration locally instead of creating actual
Lambda function in AWS:

- Create a local AWS Lambda environment using AWS SAM and AWS CDK.
(Docker based)
- Start a local Sentry server that accepts envelopes.
- Run the tests in the local AWS Lambda environment configured with a
DSN that tells the SDK to send data to the local Sentry server.
- Read the captured envelopes from the local Sentry server to assert
their correctness.
- Update CI configuration, so AWS tests are now handled the same as test
suite matrices of other integrations.

There is also a follow-up PR that removes obsolete code handling AWS
authentication data: #4076 (This PR will also fix the one failing test)

Fixes #2795

Author: antonpirker

Diff for: .github/PULL_REQUEST_TEMPLATE.md

@@ -4,4 +4,4 @@
 
 Thank you for contributing to `sentry-python`! Please add tests to validate your changes, and lint your code using `tox -e linters`.
 
-Running the test suite on your PR might require maintainer approval. The AWS Lambda tests additionally require a maintainer to add a special label, and they will fail until this label is added.
+Running the test suite on your PR might require maintainer approval.

Diff for: .github/workflows/scripts/trigger_tests_on_label.py

@@ -35,6 +35,10 @@ jobs:
         # ubuntu-20.04 is the last version that supported python3.6
         # see https://github.com/actions/setup-python/issues/544#issuecomment-1332535877
         os: [ubuntu-20.04]
+    services:
+      docker:
+        image: docker:dind  # Required for Docker network management
+        options: --privileged  # Required for Docker-in-Docker operations
     steps:
       - uses: actions/[email protected]
       - uses: actions/setup-python@v5
@@ -47,6 +51,10 @@ jobs:
       - name: Erase coverage
         run: |
           coverage erase
+      - name: Test aws_lambda latest
+        run: |
+          set -x # print commands that are executed
+          ./scripts/runtox.sh "py${{ matrix.python-version }}-aws_lambda-latest"
       - name: Test boto3 latest
         run: |
           set -x # print commands that are executed
@@ -97,12 +105,16 @@ jobs:
     strategy:
       fail-fast: false
       matrix:
-        python-version: ["3.6","3.7","3.9","3.11","3.12","3.13"]
+        python-version: ["3.6","3.7","3.8","3.9","3.11","3.12","3.13"]
         # python3.6 reached EOL and is no longer being supported on
         # new versions of hosted runners on Github Actions
         # ubuntu-20.04 is the last version that supported python3.6
         # see https://github.com/actions/setup-python/issues/544#issuecomment-1332535877
         os: [ubuntu-20.04]
+    services:
+      docker:
+        image: docker:dind  # Required for Docker network management
+        options: --privileged  # Required for Docker-in-Docker operations
     steps:
       - uses: actions/[email protected]
       - uses: actions/setup-python@v5
@@ -115,6 +127,10 @@ jobs:
       - name: Erase coverage
         run: |
           coverage erase
+      - name: Test aws_lambda pinned
+        run: |
+          set -x # print commands that are executed
+          ./scripts/runtox.sh --exclude-latest "py${{ matrix.python-version }}-aws_lambda"
       - name: Test boto3 pinned
         run: |
           set -x # print commands that are executed

Diff for: .github/workflows/test-integrations-aws.yml

@@ -28,3 +28,6 @@ relay
 pip-wheel-metadata
 .mypy_cache
 .vscode/
+
+# for running AWS Lambda tests using AWS SAM
+sam.template.yaml

Diff for: .github/workflows/test-integrations-cloud.yml

@@ -14,3 +14,4 @@ socksio
 httpcore[http2]
 setuptools
 Brotli
+docker

Diff for: .gitignore

@@ -1,6 +1,7 @@
 #!/usr/bin/env bash
 #
 # Deletes all versions of the layer specified in LAYER_NAME in one region.
+# Use with caution!
 #
 
 set -euo pipefail

Diff for: requirements-testing.txt

@@ -1,9 +1,8 @@
 #!/usr/bin/env bash
 #
-# Builds and deploys the Sentry AWS Lambda layer (including the Sentry SDK and the Sentry Lambda Extension)
+# Builds and deploys the `SentryPythonServerlessSDK-local-dev` AWS Lambda layer (containing the Sentry SDK)
 #
 # The currently checked out version of the SDK in your local directory is used.
-# The latest version of the Lambda Extension is fetched from the Sentry Release Registry.
 #
 
 set -euo pipefail