Senior Data Engineer | Anchor Search Group

RESPONSIBILITIES:

• Works with application development team, business unit process experts, and outsource technology partner to design data stream, storage, retrieval and analysis solutions

• Evaluate and implement Big Data tools and frameworks, software and hardware required to provide relevant data platform capabilities

• Develop data integration solution for IT and OT technology

• Evaluate and implement data ETL tools and establish development, test and deployment process and governance

• Review solution performance, fine tune and advise necessary infrastructure configuration update or upgrade

• Ensure compliance of data management, access control and usage with organization data governance policy.

• Design and implement data model and integration development process.

Support and provide technical advice for exploration of new technology, POC development of new IT and OT solutions, data analytics, and AI/ML development.

REQUIREMENTS:

• Proficient understanding of distributed computing principles

• 2 – 5 years experiences Databases platforms (i.e. Relational Databases, Hadoop clusters, HBase, Cassandra, MongoDB, Datastreams, apis)

• 2 – 5 years experiences with building stream-processing systems, using solutions such as Storm or Spark-Streaming

• Experience with Big Data querying tools, such as Pig, Hive, and Impala

• Experience with Spark

• Experience with messaging systems, such as Kafka or RabbitMQ

• Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O

• Experience with Cloud Big Data platform

• Good understanding of Secure Software Development, secure code quality control, and application and system integration vulnerability assessment.

• Good understanding with Application Development and Software Assurance in a highly regulated industry

• Good understanding of smart factory analytics solution such as PTC smart factory framework (ThingWorx, Kepware).

Interested candidates may send their CV to Maricel Casis (Reg No. R1221300) at anc1@anchorsearchgroup.com quoting the job title in the Subject line. We regret that only shortlisted candidates will be notified.