- Senior Data Engineer (Ex-Google) - 15+ years experience - Python, Java, Go, C, SQL - Free consultation: https://calendly.com/ajwelch/15-minute-consultation - Engagement model: 2-week sprints @ $15k per-sprint upfront
Services:
- Development - ELT: Any data warehouse, dbt, SQLMesh, Dataform - ETL: Any Python, Java or Go ETL framework - Streaming: Kafka, Flink, Dataflow/Beam, Spark - CDC/Replication: Debezium, dlt, Airbyte - Orchestration: Airflow, Prefect, Dagster - Optimization - Performance and cost optimization - Resource utilization and capacity planning - Query execution log and explain plan analysis - Query rewriting and refactoring - Data model and storage optimization - Modernization - Rewrite, transpile and translate legacy systems: - Oracle, Teradata, Hive, Informatica, DataStage, etc. - Leverage automated parsing and compilation tools: - sqlglot, jOOQ, Apache Calcite, OpenRewrite, BQMS - Observability - Data quality framework implementation: - Great Expectations, Soda, Data Validation Tool - Data lineage, root cause and impact analysis - Logging, monitoring and alerting implementation - Automation - Static analysis and build tool automation - CI/CD: Argo, Dagger, Jenkins - IaC: Teraform/CDKTF, Helm/CDK8s, Talos, KVM - Strategy - Architecture, system design and tech stack selection - Data mesh, governance, discovery and sharing - Backlog prioritization, roadmap and sprint planning
Contact:
Free consultation: https://calendly.com/ajwelch/15-minute-consultation Email: aj@ajwelch.dev Website: ajwelch.dev LinkedIn: https://www.linkedin.com/in/ajwelch4/