Data Engineer

Handshakes by DC Frontiers is an award-winning DataTech company that leverages data to empower safe, informed business decisions. We are located in 7 cities and are expanding our presence across the globe.

We are hiring an experienced Data Engineer to be based in our Singapore office. The Data Engineer will be part of our Data and AI team that is involved in building innovative products on cutting-edge technologies to solve business problems. As a Data Engineer, you will be expected to build machine learning solutions and create robust data pipelines to maintain and optimise data platforms.

Responsibilities for a Data Engineer would include but will not be limited to:

• Engaging in technical design and building reusable codes that are efficient, scalable and stable
• Developing APIs to support high throughput data processing, features engineering and other uses cases
• Creating new data pipelines, improve existing data processes and champion automation of manual processes especially in data delivery
• Collaborating with data scientists, AI engineers, product managers and other teams in developing relevant and cutting-edge data solutions tailored to business and product requirements
• Working on all aspects of data including platform and infrastructure build out, pipeline engineering as well as creating of tools and services relevant in managing the data platforms

As an experienced Data Engineer, you would have:

• Demonstrable experience in coding and scripting in languages such as Java, Scala, Go, Python, SQL or R
• Exposure to big data technologies like Spark, Airflow, Hadoop, Kafka, et al
• Strong experience with data management, data tools, relational / non-relational databases (SQL, NoSQL, MongoDB, HBase, Cassandra), ETL processes
• Experience with cloud services such as AWS, Azure or GCP a plus
• Ability to drive CI/CD, containerization, blue green deployments as well as re-designing of infrastructure for greater scalability