Data Engineering Job Description
Data engineering
provides sample SQL and data to the application development teams for understanding and validating physical data models.
Data Engineering Duties & Responsibilities
To write an effective data engineering job description, begin by listing detailed duties, responsibilities and expectations. We have included data engineering job description templates that you can modify and use.
Sample responsibilities for this position include:
Lead and develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers
Build and run forums to train resources across the enterprise
Champion rollout of industry frameworks across the company
Contribute to strategic roadmap for a technical domain
Handle highly ambiguous situations – severe operational breakdown of a mission critical platform, structuring sequencing projects with impacts across multiple platforms
Problem resolution, manages severe operational breakdown of a mission critical platform
Sought after by technical resources as the “guru” for a technical domain
Develops frameworks that are used by multiple teams and applications
Participate in external speaking engagements
Manage team of resources (both full-time associates and/or third party resources)
Data Engineering Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Data Engineering
List any licenses or certifications required by the position: AWS, ITIL, CCNP, GCP, TDWI, CCNA, TLS, SSL, SAML, SSO
Education for Data Engineering
Typically a job would require a certain level of education.
Employers hiring for the data engineering job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Statistics, Mathematics, Technical, Science, Education, Information Technology, Business, Management
Skills for Data Engineering
Desired skills for data engineering include:
SQL
Business processes
Python
Relational and columnar SQL databases
More than one programming language
Consume data
Data flows and the quantitative models that generate
Cassandra
Hive
Java
Desired experience for data engineering includes:
Associates Degree of a technical nature required
Ability to develop and modify complex data analysis documents
Prepare Bills of Materials, Product Change forms and other documentation
Proven ability to work with varied forms of data infrastructure, including relational databases
At least 5 years of experience in Implementing Large-Scale Data Solutions
Master’s Degree in mathematics, economics, engineering, or computer science
Data Engineering Examples
1
Data Engineering Job Description
Job Description Example
Our innovative and growing company is looking to fill the role of data engineering. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for data engineering
- Able to breakdown complex data issues and resolve them
- Looks to leverage reusable code modules to solve problems across the team and organization
- Work with the Data Analytics team (Data Scientists, ) to translate business requirements to functional requirements and devise realistic plans to implement the same
- Participates in creating strategies closely with business that use business intelligence and data platforms
- Works with the IS team members to design and implement data solutions in alignment with the project schedule
- Conduct data exploration and machine learning to create data insight
- Collect data from the data lake into an analytical sandbox by implementing data preparation solutions
- Implement data models within the data lake (data virtualization layer)
- Implement connectivity and data ingestion solutions between source data pools and the data lake
- Best Cost Engineering performance measurement
Qualifications for data engineering
- 10+ years of data engineering and development experience
- Proficient knowledge in designs practices including OLTP, reporting, and OLAP
- Demonstrated experience in information systems development across the IT lifecycle, with a focus on systems to perform high volume and velocity data processing on disparate data types/formats
- Demonstrated experience with identifying and delivering new, integrated and scalable solutions using current large-scale open-source and GOTS solutions for processing, storing and enabling analytics from high volume and velocity data collections ) on datastores and comprised of billions of records
- Demonstrated expertise delivering solutions to address user requirements and enrich analytic models using common industry tools to perform natural language processing, entity extraction, and data aggregation on human and machine generated data
- Demonstrated work experience in architecting new system solutions using current technologies, transitioning existing systems into modern technologies without negatively impacting operational and compliance requirements
2
Data Engineering Job Description
Job Description Example
Our company is growing rapidly and is searching for experienced candidates for the position of data engineering. We appreciate you taking the time to review the list of qualifications and to apply for the position. If you don’t fill all of the qualifications, you may still be considered depending on your level of experience.
Responsibilities for data engineering
- Establish and maintain overview lists of BCE share per order project
- Collect workload figures on monthly base and by discipline and update relevant repositories and tools
- Compare actuals with targets and analyze deviation
- Check completeness of order status (PO, invoice, SOW, CIS, 4P/P6
- Prepare overview lists and communicate necessary actions
- Work in a globally distributed team to deliver high quality solutions
- Ensure highest level of support for the Companies’ data warehouse program and applications
- Understand high-level requirements of the business
- Establishing systems of record for print and digital subscribers and creating a single view of our customers
- Evolving the infrastructure that supplies the entire organization with accurate, consistent, secure, and always available data
Qualifications for data engineering
- Demonstrated experience performing data assessment, data engineering, modeling and analytics to enable new methodologies for end user analysts, data scientists
- 3+ years of data engineering and software experience
- Enjoy discovering and learning new technologies
- Experience with large data sets and working with Hadoop, NoSQL databases, and/or graph databases
- At least 5 years experience coding in data management
- At least 7 years experience in data warehousing or at least 7 years experience in unstructured data environments
3
Data Engineering Job Description
Job Description Example
Our company is growing rapidly and is looking for a data engineering. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for data engineering
- Manage multiple small engineering teams
- Coach, mentor, and develop engineers and tech leads
- Recruit and hire extraordinary engineering talent
- Provide detailed technical evaluations of plans and code developed by your teams
- Work with product owners, project managers, and engineers to prioritize, plan and schedule work
- Coordinate with other technology teams, partner groups, and other business units to craft the right solutions, manage expectations, and keep strategies aligned
- Advocate for continuous integration, automated build and release processes, and structured development workflow
- Manage the delivery of our common data platform services
- Build relationships with the data consumers in each business unit
- Drive the vision across all product verticals
Qualifications for data engineering
- Experience in industry, code committer, published, white paper
- 7+ years of experience providing technical leadership on relevant applications - 7+ years of experience leading the full life-cycle of IT development and platform support
- Ability to develop in Python, R, Ruby, Ansible, or Chef
- Strong understanding of cloud architecture, specifically AWS, as it relates to data processing (i.e., EC2, S3, Redshift)
- Experience leading and architecting enterprise wide initiatives, specifically system integration, data warehouse build, data mart build, data lakes, for a large enterprise
- Experience with implementing data reporting and visualization tools
4
Data Engineering Job Description
Job Description Example
Our company is looking for a data engineering. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for data engineering
- Own product availability, security and compliance
- Provide professional support on all levels and serve as a key resource to his/her manager others in the firm
- Review the work of peers
- Manage the offshore strategic development team and run day-to-day team meetings with resources adhering to project plan deadlines and deliverables
- Lead a team of data engineers that builds impactful data tools and stands up critical machine learning infrastructure
- Grow your team by actively identifying and recruiting talented individual contributors
- Be a thought leader in the types of tools and architecture we stand up for our stakeholders
- Seek out inefficiencies in our processes and methodologies and actively work to correct them
- Create a world-class data engineering function utilizing cloud-based technologies
- Provide architecture support – both cloud-based and on premise
Qualifications for data engineering
- Public cloud experience AWS, Azure, Google Cloud
- Background in ETL
- Vertical specialization
- Extensive experience on distributed systems frameworks like Hadoop including hands on experience on HDFS, MapReduce
- Self-starter" attitude and the ability constantly
- An effective communicator, able to clearly articulate
5
Data Engineering Job Description
Job Description Example
Our company is looking to fill the role of data engineering. If you are looking for an exciting place to work, please take a look at the list of qualifications below.
Responsibilities for data engineering
- Train and certify the team in AWS-based ETL programming
- Manage current vendors and selection of new vendors
- Perform all data lake operations
- Responsible for leading and delivering the day to day operation of a critical Data Platform in support of a modern Wealth Management Platform
- Leads a team of Data Engineers who are responsible for the development of the Enterprise Data Platform
- Manages and leads the production support aspects of a critical data platform
- As needed, Manager will be expected to perform hands on coding, performance optimization
- Partners with Business Teams to assess how technologies can best streamline processes and/or add value
- Bottom-up valuations and cash-flow projections for complex exposures and multiple asset classes
- Communication/presenting results and analysis to internal/external stakeholders at all project phases
Qualifications for data engineering
- Experience with object-oriented design, coding and testing patterns experience in engineering (commercial or open source) Software platforms and large-scale data infrastructures
- Good practical coding experience
- Candidate will be responsible for the creation, revision and routing for approval of Packaging Bill of Specifications in SAP/ Specialized Packaging System (SPS)
- Responsible for the management of Bill of Specifications for specific assigned products and/or packaging sites
- Creation of SAP Material Master Data in Global Product Data View (GPDV), Updating SAP product unit of measure, managing GPT Procedural and technical Documentation, creation and revision of component specifications, creation of mechanical drawing and supporting document records
- Perform periodic user acceptance system testing and system data verification