ETL Job Description
ETL
provides technical leadership in the architecture, design and implementation of the data engineering best practices and data governance.
ETL Duties & Responsibilities
To write an effective ETL job description, begin by listing detailed duties, responsibilities and expectations. We have included ETL job description templates that you can modify and use.
Sample responsibilities for this position include:
Build and improve Data Warehouse / Data Mart solution by translating business requirements into robust, scalable, and supportable solutions that work well within the overall system architecture
Design and Develop Dimensional Data Models to support Data Warehouse Architecture
Develop ETL code & architect ETL process using Informatica 9.6
Monitoring and troubleshooting ETL jobs (Informatica 9.6)
Develop, implement and maintain schedule/dependency logic for automated ETL processing
Participate in the creation and maintenance of standards for coding, documentation, error handling, error notification, logging
Designs and develops ETL processes using open source/commercial tools and python scripts
Validates and unit tests ETL processes, monitors performance, and performs tuning as necessary
Helps drive technical strategies in support of the DW/BI program
Creates, and keeps current, documentation to support development work, including ETL source to target mappings, code review logs, validation results, execution logs, profiling results
ETL Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for ETL
List any licenses or certifications required by the position: AWS, ITIL, MCSA, SQL, ETL, SAS, MSSQL, II, IAT, CE
Education for ETL
Typically a job would require a certain level of education.
Employers hiring for the ETL job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Education, Engineering, Information Systems, Technical, Information Technology, Business, Computer Engineering, Science, Management
Skills for ETL
Desired skills for ETL include:
SQL
Application
Data and infrastructure architecture disciplines
Informatica
Oracle
Version and revision control practices and procedures
Hadoop
Architecture
Hive
DB2
Desired experience for ETL includes:
Participate in the delivery of the System Design Specification (SDS)
Create template jobs to accelerate development and enforce consistency
Design the error handling, scheduling, job dependencies/ interdependencies, alerting, file transfer and management, audit log, test and debug logging
Design the lineage and metadata management strategy to be incorporated in all jobs
Perform proof of concepts showing the strengths and weaknesses of ETL vs ELT designs assessing the values of pushdown processing and the effect on lineage capture
Design the staging layer, integrated layer, DataMart and history data model
ETL Examples
1
ETL Job Description
Job Description Example
Our company is growing rapidly and is looking for an ETL. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for ETL
- Ensure accuracy and integrity of data and applications through analysis, coding, documentation
- Identification of data issues, analysis of underlying problems and recommendations for solutions
- Develop test cases and data sets for testing accuracy and completeness of ETL jobs
- Report, track and resolve issues related to ETL efforts
- Understanding the core Accounts Receivable, Product Management business functions and systems
- Serving as a core member of an agile engineering team that designs and develops software applications
- Assist in the development of detailed test plans and test data for project deliverables as part of the development life cycle - Support User Acceptance Testing
- Delivery of quality solutions on-time
- Evolve the Data Warehouse environment within the organization, including better information delivery mechanisms and methodologies
- Work to develop the best technical design and approach for new solution development
Qualifications for ETL
- Provide L2, L3 support for DW applications with a focus on ETL jobs
- Monitor and analyze production environment to manage issues pro-actively
- Accept tickets and debug jobs / logs in identifying the problem
- Resolve problems within specified SLAs
- Focused approach to continuous performance improvements
- Strong experience in ETL development with tools such as OWB, ODI, Datastage...etc
2
ETL Job Description
Job Description Example
Our company is searching for experienced candidates for the position of ETL. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for ETL
- Build reusable and complex ETL setup for inbound and outbound integration
- Write Linux shell scripts for processes
- Prepare estimates, schedules and resource plans for implementing changes on current ETL setup
- Create and maintain interface agreements with the managers of interfacing applications
- Frequent update and status communication with business partners
- Develops and tests ETL data load
- Develops and tests BI solutions
- Maintains, revises, and updates current code, including troubleshooting, fixing bugs and improving system functionality
- Data Modeling (Star Schemas)
- Working with others, assists in devising problem statements and proposed
Qualifications for ETL
- Identify and design key reusable functions and mapplets to accelerate and standardise the banks Informatica environment
- Works with other team members, including DBA's, Technical Architects, QA and Business Analysts and Application Developers
- At least 3 - 5 years application support experience required in large Data Warehouse environment
- Expert using SAP BODS and strong solution architecture using ETL technology for complex data engineering problems
- Understand data management areas like metadata, data warehouse, and data mart
- Able to work effectively with onsite and offshore stakeholders, team members, and support organization
3
ETL Job Description
Job Description Example
Our company is looking for an ETL. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for ETL
- Ability to research & analyze software installation requirements and prepare pre-requisites
- Work on full cycle projects to challenge your training and experience
- Migration of Legacy Jobs into ODI
- Monitor and troubleshoot production data loads
- Day to day administration activities like user creation, folder creation, configuring DB connections Capacity planning and on-going monitoring to proactively increase capacity as needed
- Expert background in database management, ETL scripting, and automation
- Passion for refining general problem statements into specific and meaningful datasets for analytic use
- Advanced college degree in Computer Science or similar discipline
- Taking a central role in data warehouse development activities such as planning, designing, developing, testing, and implementing data system enhancements and functionality modifications
- Undergraduate degree in software engineering or related emphasis or comparable experience
Qualifications for ETL
- 2-5 years of development experience in Informatica
- Extensive experience in designing and developing of complex mappings, applying various transformations such as lookup, source qualifier, update strategy, router, sequence generator, aggregator, rank, stored procedure, filter, joiner and sorter transformations
- Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Modify, Aggregator, XML parsing stages
- Excellent communication, interpersonal, analytical and leadership skills, self-motivated, quick learner and a team player Ability to work in a team and individually, independent thinker, focused on meeting deliverables in a remote environment
- Clear understanding of RDBMS, ER, 3rd n forms, OLAP dimensional Models
- Coordinate with other technology work teams such as, ITS, Architecture, TRMIS to ensure project success
4
ETL Job Description
Job Description Example
Our growing company is hiring for an ETL. We appreciate you taking the time to review the list of qualifications and to apply for the position. If you don’t fill all of the qualifications, you may still be considered depending on your level of experience.
Responsibilities for ETL
- Is built on a single, robust and extensible data model for the 7x4 product domains / segments and common horizontals (e.g., Risk, Collections & Finance)
- Provides a consistent and common semantic layer across all the products
- Brings together data from multiple platforms and applications into a single persistence layer
- Provides a data store for Operational Data Store
- Supports MI & Regulatory reporting demands
- Provides a performant source of data for consumption by users for ad hoc query based analysis
- Provides a platform for batch algorithms or analytics engines to derive intelligence
- This position requires little supervision and participates in team strategizing, and vision execution/ implementation of the reporting and BI strategies supporting from a database stand point, collaborates with other team members/BAs in supporting shared/common reporting needs and projects
- Provides clear concise communication to project team and managers
- Collaborates with other IT teams in delivering robust, high quality and effective data transformation solutions using current ETL tools and any future acquired tools
Qualifications for ETL
- Competent in PL/SQL, TSQL, data structures and best-practice schema development and hands-on experience working on Microsoft SQL Server
- Proven track record of implementing stable and scalable data solutions
- Strong understanding of SDLC methodologies with track record of high quality deliverables and data quality, including detailed technical design documentation
- Experience a variety of ETL development tools, , Informatica, SSIS, Talend
- At least 4 years of experience creating report dashboards
- At least 4 years of experience in data and dimension modeling
5
ETL Job Description
Job Description Example
Our company is searching for experienced candidates for the position of ETL. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for ETL
- Experienced in planning and executing tests from large system wide testing (SIT, Functional, Regression, UAT, Performance)
- Experience in application analysis, design, software development, systems implementation and package integration with demonstrated strong performance
- Prior role developing/managing/working with ETL & any reporting tool
- Extensive experience in data analysis and/or reporting along with strong knowledge of database and related technologies (SQL, OLAP)
- Over 7 years of experience with ETL tools and at least 5 of them in SAP Data Services/SAP BW
- Knowledge of BW extractors from the ECC/CRM system and working knowledge of SAP structures, object dependencies and tables in CRM and ECC environments
Qualifications for ETL
- Minimum 7 years of experience in Information Technology, which can include Application Development, Database Administration, Business Intelligence
- Accreditations / Certifications in industry standard database platforms
- Experience in using industry standard data cleansing, standardization, and extraction tools
- Create or alter data integration blueprints and install, configure, and tune ETL infrastructure to support the data warehousing solution
- Develop ETL flows and framework to support ETL development
- Ability to develop using an ETL tool, Datastage required