Data Engineer

Job Description

Posting Date: 10/29/2024

Mandatory Skills and Qualifications:

• Snowflake: Proven experience in using Snowflake for data warehousing solutions.
• Databricks: Strong hands-on experience with Databricks for big data processing and analytics using Machine Learning.
• Redshift: Expertise in managing and optimizing Amazon Redshift data warehouses.
• Spark: Advanced knowledge of Apache Spark for large-scale data processing.
• Hadoop: Solid experience with the Hadoop ecosystem, including HDFS, MapReduce, Hive, and Pig.
• Cloud Platforms: AWS Proficiency
• Programming Languages: Proficiency in SQL, Python.
• ETL Tools: Experience with ETL tools and frameworks.

Good to Have:

• Apache Airflow: Experience in designing and managing workflows using Apache Airflow.
• Big Data Tools: Knowledge of other big data tools and technologies.
• Soft Skills: Excellent problem-solving skills, attention to detail, and the ability to work collaboratively in a team environment.

Education:

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.