Job Brief
If you are an experienced and passionate Data Engineer who enjoys working in a highly entrepreneurial work environment, this is the opportunity for you. Excellent career opportunity to manage, design, develop and deliver the data warehousing and pipelining environment for a
fast-growing organization in Malaysia!
Responsibilities
● Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real time on AWS EC2, EMR, RDS, Redshift
● Perform data analysis, data profiling, data cleansing, data lineage, data mapping and data transformation.
● Develop ETL / ELT jobs and workflows, and deployment of data solutions.
● Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness to optimize and fine tune processes.
● Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of data processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards.
● Prepare test data, create and execute test plans, test cases and test scripts.
● Collaborate with different stakeholders to understand data needs, gather requirements and implement data solutions to deliver business goals.
● Provide technical support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.
● Collaborate and work across functional and multidisciplinary teams in a dynamic environment to develop an understanding of evolving/agile business needs.
Requirements & Skills
● Bachelors in IT, Computer Science or Engineering
● Applicants with experience using AWS are highly favoured.
● Ideally 3 to 5 years of experience in data warehouse, operational data store and large scale data architecture implementations in Unix/ Windows