Data Engineer - Spark

Opswerks

Mandaluyong, PH

5d ago

source : Bossjob

We are currently looking for an experienced Big Data Platform Engineer who understands Spark Jobs and has working knowledge of SQL or RDBMS.

Part of your responsibility is to enable and empower users of Big Data Platform by helping them in abstracting Platform & Spark Job issues .

Bachelor’s degree or higher education

Amenable to work on a shifting schedule

Basic knowledge with database optimization

3 to 5 yrs of experience in executing and / or debugging Spark Jobs

5+ yrs of experience with Linux

Hands-on experience with Apache Iceberg and Apache Spark

Understanding of data formats like Apache Parquet or Apache AVRO

Experience with Big Data, SQL / RDBMS in ETL processing

Experience working on projects with cross-functional teams

You automate things rather than doing it twice

Excellent analytical and problem-solving skills

Experience dealing with customer issues and with excellent verbal and written communication skills

Report this job

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.