AJ Welch
Senior Data Engineer (Ex-Google)
15+ years experience
Python, Java, Go, C, SQL
2-week sprints @ $15k per-sprint upfront
Development
- • ELT: Any data warehouse, dbt, SQLMesh, Dataform
- • ETL: Any data pipeline framework, Python, Java, Go
- • Streaming: Kafka, Flink, Dataflow/Beam, Spark
- • CDC/Replication: Debezium, dlt, Airbyte
- • Orchestration: Airflow, Prefect, Dagster
Optimization
- • Performance and cost optimization
- • Resource utilization and capacity planning
- • Query execution log and explain plan analysis
- • Query rewriting and refactoring
- • Data model and storage optimization
Modernization
- • Code translation: Oracle, Teradata, Hive, Informatica
- • Data migration: transfer, reformatting and validation
- • Automation: sqlglot, jOOQ, Calcite, OpenRewrite
Observability
- • Data quality: Great Expectations, Soda
- • Data lineage: root cause analysis, impact analysis
- • Telemetry: logging, monitoring and alerting
Automation
- • Build automation: Gradle, Maven, Bazel
- • CI/CD: Argo, Dagger, Jenkins
- • IaC: Terraform/CDKTF, Helm/CDK8s, Talos, KVM
Strategy
- • Architecture, system design and tech stack selection
- • Data governance and data mesh/platform design
- • Backlog prioritization, roadmap and sprint planning