Big Data Engineer

Job Location

New York, NY, USA

Type of Job

Contract

Published Date

May 10, 2020, 5:00:00 AM

About the job

Our client is a fortune 50 media company in New York City looking for a Big Data engineer to engineer scalable real-time data pipelines and data lakes on the cloud

Requirements

We’re seeking a junior-mid level software engineer who has 2-4 years of experience building out applications / data pipelines on Amazon Web Services. You should have

-2-4 years of experience writing clean, well documented Python or Scala code in a production environment. Should have a good grasp of Python or Scala data structures and semantics
-1-4 years of experience using Amazon Web Service (EC2, S3, Athena or Redshift)
-2-4 years of experience querying / building data warehouses (Hive or Athena or Redshift or BigQuery), writing SQL queries and offloading data onto AWS S3
-Clear written and verbal communication skills
-Good understanding of Git
-Bachelor Degree / Masters Degree in Computer Science or related field
-Must live in New York City, a neighboring state or near a neighboring state
-Must be authorized to work in the US (US Citizen, Green Card holder or have a EAD)

Nice To Have:
-Experience working with Spark (even better if you have worked with AWS EMR)
-Experience working with Scala

Address

New York, NY, USA