‍Data Pipeline Development:

• Design, develop, and maintain scalable data pipelines using Google Cloud Platform services (BigQuery, Dataform, Cloud Storage, etc.).
• Implement efficient data ingestion processes from various sources.
• Ensure data quality and consistency throughout the pipeline.
• Optimize pipeline performance for speed and resource utilization.

Data Modeling and Warehousing:

• Design and implement data models for optimal storage and retrieval in BigQuery.
• Build and maintain data warehouses to support analytical and reporting needs.
• Collaborate with data analysts and scientists to understand their requirements and provide data solutions.

SQL Development:

• Write complex SQL queries and stored procedures to transform and analyze data in BigQuery.
• Optimize queries for performance and efficiency.

Python Development:

• Develop custom Python scripts and applications to automate data processes.
• Leverage Python libraries (e.g., pandas, numpy) for data manipulation and analysis.

Monitoring and Troubleshooting:

• Implement monitoring and alerting systems to proactively identify and resolve data issues.
• Investigate and troubleshoot data-related incidents.

Documentation:

• Maintain comprehensive documentation for all data pipelines, models, and processes.

Essential Qualifications:

• Proven experience with Google Cloud Platform (GCP) and its data services (BigQuery, Dataform, Cloud Storage).
• Strong SQL skills, with expertise in BigQuery SQL.
• Proficiency in Python programming, with experience in data manipulation and analysis libraries.
• Experience in designing and implementing data models.

Preferred Qualifications:

• Google Cloud Platform certification (e.g., Professional Data Engineer).
• Experience with workflow orchestration tools (Apache Airflow, Google Cloud Composer).
• Familiarity with semantic layer tools (e.g., Looker).
• Familiarity with Machine Learning techniques (Discriminative & Generative)

Additional Required Skills:

• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Ability to learn new technologies and adapt to changing requirements.

Working Conditions:

• Competitive salary and benefits package.
• Opportunities for professional development and growth.
• Work in a dynamic and innovative environment.