Design, build, and maintain complex data processing systems using various technologies such as AWS
Glue, Apache Spark, Hive, Pig, etc.
Collaborate with cross-functional teams to develop scalable, reliable, and efficient data pipelines
that enable data-driven decision making.
Manage and lead projects related to data engineering, including planning, execution, monitoring, and
reporting on project progress and status.
Develop and maintain project plans, timelines, and resource allocation for data-related projects.
Ensure effective communication among team members, stakeholders, and management through regular
meetings, reports, and dashboards.
Identify and mitigate risks associated with data engineering projects, ensuring timely and
within-budget delivery.
Collaborate with other engineers, data scientists, and analysts to resolve complex technical issues and
improve overall system performance.
Stay up-to-date with the latest technologies and trends in the field of data engineering and project
management, applying this knowledge to improve our systems and processes.