Data Systems Engineer Job Description
Data systems engineer
provides expert advice with respect to configuration management of C2S cloud environments setup and configuration, limitations, constraints, tools, resources, etc.
Data Systems Engineer Duties & Responsibilities
To write an effective data systems engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included data systems engineer job description templates that you can modify and use.
Sample responsibilities for this position include:
Handle hundreds of thousands of events/sec via a cloud based distributed architecture and process multiple TBs/sec of data across thousands of nodes
Architect and build new microservices that help manages our rapidly growing 60+ PB data hub on AWS S3
Architect and build federated metadata services (like Metacat) to manage metadata and lineage across all data sources we support (e.g., Kafka, Cassandra, RDS, Redshift.)
Build and evolve our federated job management (RESTful) service, Genie, to manage job executions in various open source data processing engines like Presto, Spark, Hive, Pig, Sqoop
Improve efficiency, reliability and scalability of our data ingestion pipelines
Lead cross-functional initiatives and collaborate with engineers across organizations
Develop and support tools for artists and production to submit, monitor and manage their workloads on the distributed compute grid
Develop and support data pipeline to gather,analyze and visualize metrics related to production workloads and workflows
Provide technical insight and be able to answer questions about the resource usage behavior and correlated workflows
Provide guidance and expertise to develop analytical methods and design tools
Data Systems Engineer Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Data Systems Engineer
List any licenses or certifications required by the position: TSG, HP, EMC, CCIE, SAN, AWS, II, IAT, SSL, MOS
Education for Data Systems Engineer
Typically a job would require a certain level of education.
Employers hiring for the data systems engineer job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Technical, Systems Engineering, Education, Science, Physics, Computer Engineering, Mathematics, Electrical Engineering
Skills for Data Systems Engineer
Desired skills for data systems engineer include:
Industry directions and trends in the area of system engineering
Avaya
Cisco
Basic server setup and management across multiple environments – desktop
CMC
CSV
Cloud
Cluster
Configuration management principles
Continuous/Batch Historians
Desired experience for data systems engineer includes:
Technical understanding of data modeling, design, architecture principles, and techniques to take business requirements from concept to implementation
Strong attention to detail and the ability to work autonomously in a fast-paced environment
Knowledge of Vulnerability Management tools, processes, procedures, and policies
Able to read and perform debugging of Java / Scala programs
A mastery of linux systems
At least 5yrs in a technical engineering or support role
Data Systems Engineer Examples
1
Data Systems Engineer Job Description
Job Description Example
Our company is growing rapidly and is searching for experienced candidates for the position of data systems engineer. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for data systems engineer
- Providing design, implementation and support of Cisco Data Center technology (Nexus, UCS, WAAS, MDS, 6500 VSS)
- Providing integration of VMware and/or Storage (EMC or NetApp) with Cisco DC technology
- Ensure that the data is of high quality so that you and others can reliably use it to deliver business functionality
- Scale the systems at sub-linear cost by addressing complex architectural problems with simple, intuitive designs
- Collaborate with cross functional partners to increase your impact and stretch you along multiple dimensions
- Take pride in your work and operate what you build
- Support Big Data Infrastructure
- Involve in delivering Infrastructure changes
- Working on the service requests as raised by the customers
- Develop future technical leaders
Qualifications for data systems engineer
- Background extracting and transforming complex data sets (ETL process design and administration)
- At least 3yrs of experience with writing code or troubleshooting with Java
- Must have some exposure to Chef or Puppet
- Experience working on Machine Learning Infrastructure at a web-scale organization
- Proficient Python, Javascript
- Relational database and SQL (Oracle, Vertica, Postgres)
2
Data Systems Engineer Job Description
Job Description Example
Our growing company is hiring for a data systems engineer. We appreciate you taking the time to review the list of qualifications and to apply for the position. If you don’t fill all of the qualifications, you may still be considered depending on your level of experience.
Responsibilities for data systems engineer
- Assist with defining the specifications for, and procurement of, equipment
- Assist with the drafting and review of OPTASK Link
- Develop Multi-TADIL architecture Microsoft Word and PowerPoint briefs
- Conduct fleet training analysis/assessment to identify gaps, training needs, and solutions
- Coordinate training requirements and support for carrier strike groups (CSG)/amphibious readiness groups (ARG)/expeditionary strike groups (ESG) and associated warfare commanders, staffs and units as integrated into fleet training programs
- Evaluating existing data center environments, designing solutions that address business issues, and implementing efficient and cost saving solutions for customers
- Creating and managing the project for key technical deliverables including, but not limited to, capacity planning, implementation, configuration, usage reporting, and allocation to host
- Providing guidance regarding architecture and application processes to the engineering team and the project as a whole
- Providing pre-sales engineering support to sales team to ensure that all needs of any sales opportunities are fulfilled
- Providing Level 3 support for all installed platforms and providing operational health of the Open Systems infrastructure and the applications used to control it
Qualifications for data systems engineer
- Software development using Linux (or UNIX derivative)
- Good understanding of web service technologies (REST,JSON)
- Excited by building and operating reliable, self-healing infrastructure services on unreliable hardware
- 3-5+ years of experience in systems engineering in large scale Linux/UNIX data center environments
- 3-5+ years experience in Java, Python, Ruby, Perl, or other language
- Solid understanding of security infrastructure such as Kerberos, LDAP, NIS
3
Data Systems Engineer Job Description
Job Description Example
Our growing company is looking for a data systems engineer. We appreciate you taking the time to review the list of qualifications and to apply for the position. If you don’t fill all of the qualifications, you may still be considered depending on your level of experience.
Responsibilities for data systems engineer
- Conduct source system and data quality analysis
- Extract, transform, and load data into Enterprise Systems and Reporting tools
- Change management and creation of other supporting documentation for applications
- Able to define metrics that need to be collected to determine usage and effectiveness
- Develop approach to extract metrics from database structures, primarily SQL
- Facilitate end-user procedures development related to systems’ usage
- Conduct data investigations across multiple integrated systems
- Participate in business process re-engineering activities
- Participate in system integration testing and data verification
- Document all procedures related to position
Qualifications for data systems engineer
- Deliver on business functionality while also making infrastructure improvements
- Experience working with relational databases (preferably Oracle)
- Provide technical and management support to determine Navy's use and employment of distributed Multi-INT fusion architecture capabilities
- Understanding of messaging / queuing systems
- Experience with large scale paradigms (Hadoop, Map Reduce, Hive, Pig), workflows (Oozie, cascading, scalding), databases (HBase, Accumulo, Mongo) and data serialization (Avro, thrift, xml)
- DoD 8570 Certification, including Security+, CASP, CISSP, or CISM or obtain within 6 months of hire
4
Data Systems Engineer Job Description
Job Description Example
Our growing company is looking to fill the role of data systems engineer. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for data systems engineer
- Ability to translate high-level requirements into detailed data systems designs and ability to lead the implementation of complex systems projects within the data center
- Responsible for system architecture, design, implementation and integration of systems within the Scientific Computing environment
- The ability to understand and interpret C, C++, C#, and VBA code to manage and maintain repair systems and tools
- Interface daily with functional business partners, users of the systems to develop and maintain system tools that support the Programs business
- Diagnose system failures to isolate the source of problems between equipment, software, and applications
- Coordinate and interface between a multitude of projects and functional program groups
- Design decisions regarding tool choice , interface development and method functionality
- Develop and maintain applications using C, C++, C#, VBA programming, and SQL
- Design database schema ( including complex queries ) to support business applications
- Apply knowledge of general business practices associated with cost budgeting, financial forecasting, processing cycle times, scheduling, material constraints, sales, etc to assist Program Management in the development efforts to support program efficiency and profitability
Qualifications for data systems engineer
- Must have experience in MS Windows desktop system administration and MS Server 2008 or later Active Directory environment in addition to Red-Hat Linux operations system administration
- The team is looking for an experienced Systems Engineer with prior experience in the implementation of tools and services that adhere to Sponsor or IC data handling, tagging, compliance, and security requirements
- Prior experience performing data assessments, data engineering, and modeling
- Experience in the areas of data management, data analysis, and dissemination and distribution
- Minimum of a Bachelor degree in Computer Science, Applied Mathematics, Software or Electrical Engineering
- Proficient with high-level client, object-oriented language (e.g., C#, C++, JAVA, Python, Perl)
5
Data Systems Engineer Job Description
Job Description Example
Our growing company is hiring for a data systems engineer. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for data systems engineer
- Communicating experimental results through reports and presentations
- Providing work direction to technicians
- Creating new research ideas
- Developing broadly applicable tools for data analysis and visualization
- Participates in the design and implementation of various new system implementations and upgrades
- Analyze, report, and advise on various systems and applications performance issues
- Provide day-to-day technical, administrative, and functional support for the various IMS platforms and systems
- Participate as a key technical resource for current and new systems planning and scoping
- Participate in the analysis of new software applications, application architecture, and configurations, and participate as a key member of the team in reconfiguring systems, databases, and applications for optimal performance
- Participate in the creation (or modification) of documentation activities related to system configuration, policies, and procedures
Qualifications for data systems engineer
- Proficient with web programming language (PHP, MySQL, Python, Perl, Javascript, ASP)
- Significant experience with big data processing and/or developing applications and data sources via Hadoop, Yarn, Hive, Pig, Squoop, MapReduce, HBASE, Flume
- Knowledge of performance analysis tools and techniques for multi-threaded systems
- Basic understanding of kernel internals
- Familiarity with algorithms that work on on-disk data structures, a plus
- Knowledge in deduplication approaches a plus