Cloud Data Engineer

DUTIES & RESPONSIBILITIES:

The Data Engineer will develop AWS solutions such as High Performance Computing, Batch/Real-time Data processing, Massively Parallel Processing systems.

 General Accountabilities:

  • Utilizing AWS services such as Redshift, Database Migration Service, Glue, EMR, Elastic Compute Cloud (EC2), S3, Relational Database Service (RDS)/Aurora, and Amazon Kinesis, Athena, API Gateway, Cognito, Lambda, Python, PySpark, and other Cloud Solution Providers Data Analytics Services, and SaaS integration points
  • Ingesting data (structure, unstructured, semi-structured) in a controlled and transparent process
  • Designing and developing data API’s for reusability and for the purposes of reporting and moving from batch to real time data integrations.

Qualifications:

  • Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics or a related field
  • Knowledge of Cloud Computing, AWS services such as EC2, S3, VPC and Athena
  • 5+ years of experience of IT platform implementation in a highly technical and analytical role
  • 3+ years of hands-on experience in implementation and developing Data Lakes and exposing data via API’s
  • Ability to drive discussions with senior personnel regarding trade-offs, best practices, project management and risk mitigation
  • Current hands-on implementation experience required
  • Develop innovative solutions to complex business and technology problems
  • Experience working with serverless computing

Preferred Qualifications

  • Extensive hands on experience in developing and tuning Glue ETL/ELT processes
  • Excellent SQL and strong hands-on Python scripting ability
  • Experience implementing AWS services in a variety of distributed computing, enterprise environments
  • Ability to think strategically about business, product, and technical challenges in an enterprise environment

Education

Preferred

Bachelors or better in Computer Science, Engineering, or Mathematics

Submit Resume