
Big Data Engineer
Job Location
New York, NY, USA
Type of Job
Contract
Published Date
May 10, 2020, 5:00:00 AM
About the job
Our client is a fortune 50 media company in New York City looking for a Big Data engineer to engineer scalable real-time data pipelines and data lakes on the cloud
Requirements
We’re seeking a junior-mid level software engineer who has 2-4 years of experience building out applications / data pipelines on Amazon Web Services. You should have
-2-4 years of experience writing clean, well documented Python or Scala code in a production environment. Should have a good grasp of Python or Scala data structures and semantics
-1-4 years of experience using Amazon Web Service (EC2, S3, Athena or Redshift)
-2-4 years of experience querying / building data warehouses (Hive or Athena or Redshift or BigQuery), writing SQL queries and offloading data onto AWS S3
-Clear written and verbal communication skills
-Good understanding of Git
-Bachelor Degree / Masters Degree in Computer Science or related field
-Must live in New York City, a neighboring state or near a neighboring state
-Must be authorized to work in the US (US Citizen, Green Card holder or have a EAD)
Nice To Have:
-Experience working with Spark (even better if you have worked with AWS EMR)
-Experience working with Scala
Address
New York, NY, USA