How we tested GateCast's Brazil grades: the test plan

Before we graded any connection in Brazil, we wrote down how the grades would be tested and what would count as a pass. We fixed the plan on 23 October 2026, while the flight records for the build and test months were being downloaded. The test months' actual times and cancellations then stayed unread until the single opening on 25 October, apart from one row disclosed below. This page is the public version of that plan and of every change we made to it before the results were opened on 25 October 2026. The results are on a separate page.

Public version, edited from our internal record for readers: internal names, file paths and working notes are removed. The internal record is kept, and each step in it was committed with a timestamp and a checksum before the step that followed.

1. The data and the periods

2. What counts as a missed connection

3. What was tested

The model is the Brazil connection-grade model as committed before any test prediction was made, with GateCast's grading logic unchanged from the US. Each test was scored separately, so a failure in one couldn't fail another:

4. The pass bars

  1. Order: the realised missed-connection rate rises from A to F, with at most one inversion, and only one that lies inside the 95% intervals.
  2. Calibration: the average gap between predicted and realised rates across grades is at most 3 percentage points.
  3. Bands: each grade with 500 or more test cases lands within 5 points of the published figure for that grade. (Which figures were used is set out in section 7.)
  4. Ranking: predicted and realised missed-connection rates are positively correlated, with the 95% interval above zero.
  5. Coverage: at least 2,000 graded test cases per hub. A hub below that isn't graded.

Intervals come from resampling 7-day blocks of the test period (2,000 resamples, fixed seed), so a bad week counts as one unit. Bars 2 and 3 apply to domestic connections. Single flights use bars 1, 4 and 5, because we publish no per-grade percentage for flights. International-to-domestic connections use bars 1, 2, 4 and 5.

5. Order of work and hard stops

The work ran in a fixed order: the plan, checks on the build months, the test flight table, the model commit, sealed predictions from scheduled times only, then one opening of the outcomes, followed by a second, separate reading of the raw records and a hand check. The plan named stops, any one of which would have ruled out a verdict. They were:

A failed bar allows no re-tuning on the test months. A retry needs a new plan on months not yet opened.

6. Checks on the build months, before the model was committed

7. Changes made before the opening

Every change below was committed before the test predictions existed, unless it says otherwise. None was made after seeing a test-month outcome.

8. Owner's decisions after the results (outside the test)

  • Pooled schedule versions (approved by the owner, live from 30 October 2026). A domestic connection whose own schedule version has too few days is graded on the same flight numbers' versions within an hour of its departure time. This was checked separately, on months already opened (September 2025 to May 2026), and was not tested by this plan.
  • 9. Limits stated with any Brazil result

    Flight records: Agência Nacional de Aviação Civil (ANAC), Voo Regular Ativo (VRA), January 2024 to May 2026 (downloaded 23 October 2026) and June to August 2026 (downloaded 21 October 2026), published under a Creative Commons Attribution licence on dados.gov.br. ANAC had no part in GateCast and does not endorse it; grades and figures are Wingmark Analytics' own estimates.
    Dados de voos: Agência Nacional de Aviação Civil (ANAC), Voo Regular Ativo (VRA), janeiro de 2024 a maio de 2026 (obtidos em 23 de outubro de 2026) e junho a agosto de 2026 (obtidos em 21 de outubro de 2026), licença Creative Commons Atribuição (dados.gov.br). A ANAC não participa do GateCast nem o endossa; as notas e os números são estimativas da Wingmark Analytics.
    Checksums (SHA-256): test flight table 5fd945a2…, sealed predictions 76faaf3f…846d, outcomes 3e00a73d….
    Plan fixed 23 October 2026; results opened 25 October 2026. Public version prepared 2 November 2026.