Job Summary:
The Data ETL / Data Engineer will design, develop, test, and maintain scalable data integration and ETL solutions, with a strong focus on SQL, Python, PySpark, data warehousing, and large-scale data processing. The role will work with modern cloud-based data platforms including Databricks, Snowflake, and PostgreSQL, while applying performance optimization, version control, CI/CD practices, and AI-powered development tools to deliver efficient and reliable data solutions in an onsite environment.
Key Responsibilities:
• Design, develop, test, and maintain ETL and data pipeline solutions.
• Build scalable data processing workflows using Python and PySpark.
• Develop and optimize SQL/PLSQL scripts for data extraction, transformation, and loading.
• Design and maintain data warehouse architectures and data models.
• Perform query performance tuning and optimization for large datasets.
• Develop and support data solutions across Databricks, Snowflake, and PostgreSQL environments.
• Manage source code repositories using Bitbucket/Git and follow CI/CD best practices.
• Leverage AI-powered development tools such as GitHub Copilot and Windsurf to improve productivity and code quality.
• Collaborate with business stakeholders, data analysts, and cross-functional teams to deliver data solutions.
• Create technical documentation and support production deployments.
• Develop shell scripts to support data engineering and operational activities as needed.
• Contribute to AI Agent development and AI-driven data solutions as required.
Required Qualifications:
• 5+ years of experience in data ETL and/or data engineering.
• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
• Strong experience with ETL development, data integration, and data engineering.
• Hands-on experience with SQL/T-SQL, PL/SQL, Python, and PySpark.
• Strong experience with database development, data warehousing concepts, and development.
• Experience with query performance tuning and optimization.
• Knowledge of cloud-based data platforms and modern data engineering practices.
• Experience with Bitbucket/Git and modern version control practices.
• Experience leveraging AI development tools such as GitHub Copilot or Windsurf.
• Strong analytical, troubleshooting, and problem-solving skills.
Preferred Qualifications:
• Experience with Databricks and Snowflake.
• Experience with PostgreSQL, including AWS RDS PostgreSQL.
• Knowledge of AWS cloud services.
• Experience with shell scripting.
• Exposure to AI Agent development and Generative AI technologies.
• Experience working in Agile development environments.