Current Openings

ETL/Data Pipeline Developer.

Post Date: 07/15/20
Job ID: 20-00738
Job Type:

Job Description

Job Title: ETL/Data Pipeline Developer.
Location: Raleigh, NC
Duration: 12 Months
Interview Type: Both Phone & In-person
Job Description:
Primary Purpose of the Position The Extract, Transform, Load (ETL) Developer is responsible for the development, management, performance, and optimization of the Extract, Transform, and Load processes; including aiding in implementation, maintenance and optimization the associated technical solutions. This position will partner with key data stakeholders, IT leadership, project managers and architecture leads for the purpose of supporting the Department's Business Intelligence Data Platform (BIDP) needs.

The ETL Developer is responsible for:

" Working with Data Architects, Analysts, and Scientist to aid in BIDP data modeling efforts
" Implement new ETL based technologies within the BIDP environment " Preform ETL workload testing
" Conducting ETL optimization, troubleshooting and debugging, report regularly on health and performance of ETL environment and jobs
" Maintain ownership of release activities interacting with ETL projects
" Perform import and export ETL jobs across various ETL projects and servers
" Assist in discovering, evaluating, and qualifying new technologies around BIDP ETL functions
" Partner with BIDP stakeholders to establish and maintain policies, procedures, operational standards around the ETL functions
" Help business in leveraging the BIDP through the ETL process
" Strong knowledge and hands-on experience with ETL tools (AWS Glue preferred)
" Experience in data modeling
" Knowledge of compliance frameworks PCI, SOX, SOC 2, ISO 27001 and the ability to apply their requirements and concepts to a complex environment
" Knowledge and hands-on expertise with Structured Query Language (SQL)
" Strong interpersonal communication and ability to solve complex problems
" Experience in debugging
" Hands-on experiences with databases e.g., SQL, MYSQL, Oracle, etc.
" Strong technical experience, knowledge, and understanding of micro-services architecture
" AWS, Azure or GCP background (preferably all three), high-level programming or sysadmin experience (preferred)
" Experience with enterprise-level cloud-based development, deployment, and auditing, including PAAS, IAAS, and SAAS. (preferred)
" Proficiency in scripting languages e.g., Python, Perl, Bash, JSON, etc.