Data Engineer

  0
0

Job Summary:

 

Are you passionate about data and making a difference in the safety and soundness of the country’s financial systems?  Advantage Tech is seeking a Data Engineer to provide data services to one of our client’s Massively Parallel Processing (MPP) data warehouse.  This position is key in supporting The Comprehensive Capital Analysis and Review (CCAR) and Dodd-Frank Act Stress Tests (DFAST).

 

Key aspects of this position include:

  • Provide production support of Extract, Load, & Transform (ELT) workflows
  • Support the acquisition and documentation of data
  • Create and execute the ELT data pipeline for a columnar based data warehouse
  • Contribute to the design of new data warehouse components and/or data marts
  • Automate data quality processes

 

Key Activities:

 

  • Perform complex data migration tasks to transform, create new variables, and merge data.
  • Develop and support self-monitoring, robust, scalable data pipeline ELT jobs using Python/SQL and a combination of other languages to implement pre-defined business rules, quality checks and metrics, ensuring scalability and data quality in data warehouse processes
  • Ensure data pipeline ELT jobs are well tested and monitored
  • Conduct data profiling to ensure data quality and data integrity are maintained at all times
  • Provide documentation (Data Mapping, Technical Specifications, Production Support, data dictionaries, test cases, etc.) for all projects
  • Provision data structures such as fact and dimension tables and other objects as needed
  • Manage database supporting elements including schemas, tables, views, etc.
  • Manage permissions to ensure data accessibility, reliability and integrity
  • SQL Query development and Optimization
  • Data Modeling

 

 

Qualifications:

 

  • Bachelor’s degree from an accredited college or university in related field or equivalent combination of education and experience
  • 3+ Years writing PL/SQL procedures and functions
  • 3+ Years Unix/Linux/Python scripting
  • Ability to diagnose complicated data warehouse ETL processes, data flows and business logic failures, and quickly resolve issues
  • Strong performance-tuning skills
  • Strong understanding of dimensional modeling and other data warehousing techniques
  • Keen attention to detail
  • Good organizational, project management and problem-solving skills
  • Strong oral and written communication skills. Ability to explain complex technical information to technical and nontechnical contacts
  • Strong interpersonal skills, including the ability to work effectively in a team environment; motivate and work through others to accomplish tasks; and deal honestly and directly with others 

Skills: 

  • Proficient in SQL, Linux, Python, and Bash
  • Competent in Extract, Load, & Transform techniques
  • Competent in Data Analytics, Data Modeling, and Data Quality
  • Competent in git / code management
Submit Resume