Skip to content

Conversation

@nitaibezerra
Copy link
Contributor

Summary

  • Add comprehensive Apache Airflow tutorial (docs/onboarding/airflow-tutorial.md) covering:

    • Introduction and motivation (why Airflow over alternatives)
    • Architecture and infrastructure components (Scheduler, Web UI, Triggerer, DB, Workers)
    • Local setup with Astro CLI
    • Fundamental concepts (DAG, tasks, operators, dependencies)
    • Essential operators (PythonOperator, BashOperator, Sensors)
    • Intermediate concepts (execution_date, backfill, XComs, Variables, Connections, TaskFlow API)
    • Advanced patterns (branching, dynamic task mapping, task groups, trigger rules)
    • Best practices and anti-patterns
    • Monitoring and debugging
    • Application to DestaquesGovBr pipeline with realistic DAG example
    • 5 practical exercises (beginner to advanced)
    • Complete glossary of terms
  • Update mkdocs.yml with navigation entry

  • Update roteiro-onboarding.md:

    • Add Airflow to backend developer track
    • Update mermaid diagram
    • Add Airflow exercises
    • Add Airflow to competencies table
    • Add Airflow items to backend checklist

Test plan

  • Review tutorial content for accuracy
  • Verify mermaid diagrams render correctly
  • Test code examples locally with Astro CLI
  • Build docs with mkdocs build to verify no broken links
  • Navigate through the tutorial in rendered documentation

🤖 Generated with Claude Code

nitaibezerra and others added 2 commits December 12, 2025 09:49
Add a complete Airflow tutorial covering:
- Introduction and motivation (why Airflow)
- Architecture and infrastructure components
- Local setup with Astro CLI
- Fundamental concepts (DAG, tasks, operators)
- Intermediate concepts (execution_date, backfill, XComs, TaskFlow API)
- Advanced patterns (branching, dynamic tasks, task groups)
- Best practices and anti-patterns
- Monitoring and debugging
- Application to DestaquesGovBr pipeline
- 5 practical exercises from beginner to advanced
- Complete glossary

Also updates:
- mkdocs.yml: add navigation entry
- roteiro-onboarding.md: add Airflow to backend track, competencies, and checklist

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@nitaibezerra nitaibezerra merged commit 891e86d into main Dec 12, 2025
1 check failed
@nitaibezerra nitaibezerra deleted the docs/airflow-tutorial branch December 12, 2025 13:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants