Synchronize test-suite branch with main #152

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

henkberendsen merged 86 commits into henk/test-suite from main

Oct 19, 2025

.github/ISSUE_TEMPLATE/bug.md

-Original file line number
+Diff line change
@@ Expand Up / @@ -2,7 +2,7 @@ @@
     name: Bug
     about: Template for a problem with the library's behaviour
     title: ""
-    labels: Bug
+    type: Bug
     assignees: ''
     ---
@@ Expand Down @@

.github/ISSUE_TEMPLATE/task.md

-Original file line number
+Diff line change
@@ Expand Up / @@ -2,7 +2,7 @@ @@
     name: Task
     about: Template for the smallest actionable chunk
     title: ''
-    labels: Task
+    type: Task
     assignees: ''
     ---
@@ Expand Down @@

.github/workflows/CI_test_suite.yml

            
                      Original file line number
                      Diff line number
                      Diff line change
                  
    @@ -2,26 +2,29 @@ name: CI Test Suite
  
    on:

      push:

        branches: [ "main" ]

        branches: 

          - "main"

          - "henk/*"

      pull_request:

        branches: [ "main" ]

    jobs:

      SystemTests:

      SystemTestsSequential:

        runs-on: ubuntu-latest

        if: ${{ github.event_name == 'pull_request' }}

        steps:

        - uses: actions/checkout@v4

        - name: Set up Go

          uses: actions/setup-go@v5

          with:

            go-version: '1.22'

            go-version-file: go.mod

        - name: Set up Python

          uses: actions/setup-python@v5

          with:

            python-version: '3.9'

            python-version: '3.12'

        - name: System tests dependencies

          run: xargs -a system_test_requirements.txt sudo apt-get install

    @@ -31,9 +34,9 @@ jobs:
  
          run: pip install -r python_requirements.txt

          working-directory: test_suite

        - name: Run system tests

        - name: Run system tests sequentially

          id: system-test

          run: ./system_tests.sh -c 0

          run: ./system_tests.sh -b

          working-directory: test_suite

          continue-on-error: true

    @@ -47,7 +50,42 @@ jobs:
  
          if: ${{ steps.system-test.outcome == 'failure' }}

          run: exit 1

      IntegrationTests:

      SystemTestsParallel:

        runs-on: ubuntu-latest

        if: ${{ github.event_name == 'push' }}

        steps:

        - uses: actions/checkout@v4

        - name: Set up Docker Buildx

          uses: docker/setup-buildx-action@v3

        - name: Build Dockerfile to run system tests in parallel

          uses: docker/build-push-action@v6

          with:

            file: test_suite/Dockerfile

            load: true

            tags: system_tests:latest

            build-args: BRANCH=${{ github.ref_name }}

            cache-from: type=gha

            cache-to: type=gha,mode=max

        - name: Run system tests in parallel

          id: system-test

          run: GITHUB_ACTION=true ./system_tests.sh -t 4

          working-directory: test_suite

          continue-on-error: true

        - name: Upload system test logs

          uses: actions/upload-artifact@v4

          with:

            name: system-test-logs

            path: test_suite/system_test_logs/

        - name: Fail job if system test failed (for clarity in GitHub UI)

          if: ${{ steps.system-test.outcome == 'failure' }}

          run: exit 1

      PerformanceTests:

        runs-on: ubuntu-latest

        steps:

        - uses: actions/checkout@v4

    @@ -57,6 +95,99 @@ jobs:
  
          with:

            go-version: '1.22'

        - name: Set up Python

          uses: actions/setup-python@v5

          with:

            python-version: '3.12'

        - name: System tests dependencies

          run: xargs -a system_test_requirements.txt sudo apt-get install

          working-directory: test_suite

        - name: Performance tests dependencies

          run: pip install -r python_requirements.txt

          working-directory: test_suite

        - name: Run performance test with varying bitrate

          id: system-test

          run: ./system_tests.sh -b -p -L performance

          working-directory: test_suite

          continue-on-error: true

        - name: Upload performance test graphs

          uses: actions/upload-artifact@v4

          with:

            name: performance-test-graphs

            path: test_suite/system_test_logs/performance/*/*.png

        - name: Upload performance test data

          uses: actions/upload-artifact@v4

          with:

            name: performance-test-data

            path: test_suite/system_test_logs/performance/*/performance_test_data.json

        - name: Upload full performance test logs

          uses: actions/upload-artifact@v4

          with:

            name: performance-test-logs

            path: test_suite/system_test_logs/

        - name: Fail job if performance test failed (for clarity in GitHub UI)

          if: ${{ steps.system-test.outcome == 'failure' }}

          run: exit 1

        - name: Download artifact from target branch head

          id: download_target_branch

          if: ${{ github.event_name == 'pull_request' }}

          uses: dawidd6/action-download-artifact@v9

          with: 

            branch: ${{ github.base_ref }}

            name: performance-test-data

            path: ./test_suite

            skip_unpack: true

            workflow_conclusion: ""

          continue-on-error: true

        - name: Download artifact from previous commit

          id: download_previous_commit

          if: ${{ github.event_name == 'push' }}

          uses: dawidd6/action-download-artifact@v9

          with: 

            commit: ${{ github.event.before }}

            name: performance-test-data

            path: ./test_suite

            skip_unpack: true

            workflow_conclusion: ""

          continue-on-error: true

        - name: Stop job and give warning if downloading previous artifact failed 

          if: ${{ steps.download_target_branch.outcome == 'failure' || steps.download_previous_commit.outcome == 'failure' }}

          run: |

            echo "# ⚠️ Could not make performance comparison" >> $GITHUB_STEP_SUMMARY

            echo "Downloading performance test data of target branch head/previous commit failed. See the corresponding PerformanceTests job step for details" >> $GITHUB_STEP_SUMMARY

        - name: Unzip artifact

          working-directory: test_suite

          if: ${{ steps.download_target_branch.outcome == 'success' || steps.download_previous_commit.outcome == 'success' }}

          run: unzip performance-test-data.zip -d previous_performance

        - name: Compare current and artifact performance, and redirect results to job step summary

          id: performance-comparison

          working-directory: test_suite

          if: ${{ steps.download_target_branch.outcome == 'success' || steps.download_previous_commit.outcome == 'success' }}

          run: python compare_performance.py previous_performance/ system_test_logs/performance/ > $GITHUB_STEP_SUMMARY

      IntegrationTests:

        runs-on: ubuntu-latest

        steps:

        - uses: actions/checkout@v4

        - name: Set up Go

          uses: actions/setup-go@v5

          with:

            go-version-file: go.mod

        - name: Run integration tests

          id: integration-test

          run: go test -coverpkg=./... -coverprofile cover.out -v ./...

.github/workflows/golangci-lint-main.yml

-Original file line number
+Diff line change
@@ -0,0 +1,23 @@
+    name: golangci-lint
+    on:
+      push:
+        branches:
+          - main
+    permissions:
+      contents: read
+    jobs:
+      golangci:
+        name: lint
+        runs-on: ubuntu-latest
+        steps:
+          - uses: actions/checkout@v4
+          - uses: actions/setup-go@v5
+            with:
+              go-version-file: go.mod
+          - name: golangci-lint
+            uses: golangci/golangci-lint-action@v6
+            with:
+              version: v1.60
+              args: -E stylecheck,revive,gocritic,gofumpt

.github/workflows/golangci-lint-pr.yml

-Original file line number
+Diff line change
@@ -0,0 +1,23 @@
+    name: golangci-lint
+    on:
+      pull_request:
+    permissions:
+      contents: read
+      pull-requests: read
+    jobs:
+      golangci:
+        name: lint
+        runs-on: ubuntu-latest
+        steps:
+          - uses: actions/checkout@v4
+          - uses: actions/setup-go@v5
+            with:
+              go-version-file: go.mod
+          - name: golangci-lint
+            uses: golangci/golangci-lint-action@v6
+            with:
+              version: v1.60
+              args: -E stylecheck,revive,gocritic,gofumpt
+              only-new-issues: true

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Synchronize test-suite branch with main #152

Uh oh!

Diff view

Diff view

There are no files selected for viewing

Uh oh!

Uh oh!