Senior BigData Engineer

Our client is a dynamic tech company dedicated to supporting educational institutions during a transformative period in their operations. With a focus on providing cutting-edge solutions, this rapidly expanding organization is committed to assembling a team of exceptional individuals who are passionate about crafting unparalleled experiences for clients. By fostering a culture of innovation and collaboration, this company aims to continually enhance its offerings and create an environment that surpasses expectations. The main goal for the Engineering Team is to implement a feature allowing recipients to opt out of unwanted email communications. This feature will streamline the opt-out process, improve user experience, and reduce the manual workload for the support team. IF YOU ARE A Big Data Engineer specializing in data pipeline creation, batch, and streaming processing Experienced in developing data solutions on AWS platform Proficient in Python and SQL Confident in data build tool (dbt) Accustomed to utilizing Apache Spark, Apache Airflow and Databricks Familiar Managed Apache Airflow (MWAA) setup and data pipeline development Knowledgeable about data warehousing (Redshift) A powerful communicator asking appropriate and insightful questions Skillfully breaking down customer requirements into development tasks Good at providing estimations Experienced in leading a team of fellow data engineers AND YOU WANT TO Be part of a team of data-focused engineers dedicated to continuous learning, improvement, and knowledge sharing every day Work with a cutting-edge technology stack, including innovative services from major cloud providers Engage with customers from diverse backgrounds, ranging from large global corporations to emerging crypto startups preparing to launch their first product Be involved in the entire project lifecycle, from initial design and proof of concepts (PoCs) to minimum viable product (MVP) development and full-scale implementation