Data Software Engineer Job Description
Data Software Engineer Duties & Responsibilities
To write an effective data software engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included data software engineer job description templates that you can modify and use.
Sample responsibilities for this position include:
Data Software Engineer Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Data Software Engineer
List any licenses or certifications required by the position: AWS, SSL, MCSE, RHCE, ITIL, SSH, MDG, SAP, GCP, RDS
Education for Data Software Engineer
Typically a job would require a certain level of education.
Employers hiring for the data software engineer job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Computer Engineering, Information Systems, Science, Technical, Mathematics, Education, Statistics, Software Engineering
Skills for Data Software Engineer
Desired skills for data software engineer include:
Desired experience for data software engineer includes:
Data Software Engineer Examples
Data Software Engineer Job Description
- Interface with Bioinformatics Scientists and Research Scientists
- Mine existing empirical data sets to develop performance metrics for real-time post-hoc use
- Fix bugs, develop new features, and review contributions to open-source communities
- Develop open source data-driven applications to solve real-world data problems
- Interact with a globally distributed, technical team
- Publicize work through blogs and social media
- Participate in process improvement and compliance to successfully and consistently deliver high-quality services on time, and to specification, enabling flexibility to react quickly to changes in priorities or circumstances to meet the needs of the business
- Complete simple data operation fixes
- Work closely with other development team members to understand product requirements and translate them into system automation designs
- Proven ability to estimate tasks and to deliver upon committed dates
- BS in Computer Science, Engineering, Technology or related fields
- 6+ years using Big Data Technologies like Hadoop, Spark, NoSql technologies
- Expertise in building highly scalable distributed systems using NoSql systems & Hadoop
- Experience in working with No Sql databases using OR frameworks, Java Persistence API
- Experience in implementing service-oriented (SOA) architectures and web services
- Experienced in Agile development methodologies / Continuous Integration
Data Software Engineer Job Description
- Optimize datastore architecture and configurations to improve performance efficiency
- Responsible for operating the entire platform, from data pipelines to data stores to analytics to machine learning
- Design and build analytic tools
- Your designs will include identifying user scenarios, establishing quality criteria and building test automation harnesses that will allow complex testing to be performed for the tools provided by our data engineering team
- You'll also conduct research on emerging technologies to analyse systems, decompose complicated software systems and design strategies to test them, building advanced and automated test suites to exercise our ground breaking products
- You will provide high quality reporting on product readiness and verify proper testing coverage and procedures both independently and collectively in a team environment
- Support the maintenance of our existing post-processing capability (e.g., bug fixing, code cleanup)
- Developing new post-processing features based on user requests and internal ideas
- Participating in regularly scheduled team conference calls by contributing ideas to drive innovation in our technology
- Participating in periodic in person meetings to plan for future releases (approximately 1-2 trips per year)
- Experience with new and emerging technological trends in the big data domain, such as dynamic data modeling
- At minimum, a bachelor’s degree in computer science
- Experience with large-scale systems is highly desirable
- A keen interest in building and maintaining large-scale, error-free data sets
- 3-10 years of industry or equivalent programming experience
- BS, MS, or PhD in computer science or a related field, or equivalent work experience
Data Software Engineer Job Description
- Work directly with business owners and application/informatics development groups as a member of their team in design, testing, implementation, debugging, problem analysis, recovery and documentation pipelines—owning the pipeline from idea to support
- Participate in hackathon efforts, bringing new innovative ideas to future versions of our software
- Leverage homegrown Big Data framework off-the-shelf tools, as appropriate
- Build, Develop and Maintain Data Pipeline, Batch Processes and Streaming Applications
- Develop and Support Production Systems for Data Science Applications
- Work with other Engineering Teams to improve and enhance data collection and processing
- Work with Product and Business Teams to improve and enhance analytics and processing
- Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring
- Work within an agile team to develop and enhance data feed products
- Develop customized deliveries and proof of concepts to help generate new business and product ideas
- Deep working knowledge in relational database technologies (preferably Microsoft SQL Server, and Sybase), ISAM (c-tree), blended data environments (c-treeACE, PervasiveSQL), and textual documents (XML, CSV) including data relationships (foreign keys, compound keys, user-defined types)
- Experience in object-oriented software engineering methodologies
- Minimum of 5 years of technical experience in software development environment
- Minimum of 5 years of technical experience in database technologies
- Current on new technology and development techniques within the software industry
- Data manipulation experience using R and Python
Data Software Engineer Job Description
- Design and development of data infrastructure to maintain the pipeline of data sources to the production environment
- Design and develop automated tools and process for end to end production deployment
- Design toolset for assessing the quality of data using statistics based validation techniques
- Maintain a pipeline of data for R&D
- Design component level unit tests for data infrastructure
- Perform integration level testing
- Providing Second Level Production Support as needed to ensure the correct functioning of the production data systems on a 24/7 basis
- Providing technical input for Software Engineers and analysts including, setting priorities, and providing Proof of Concepts, coaching, reviewing work products and the reporting of team activities
- Coordinating and mentoring consultants and Software Engineers assigned to projects or support activities
- Additional tasks as assigned by other senior personnel
- Web technologies, including HTML, CSS, and JavaScript
- Experience with Networking technologies, Graphics, Windows programming and OS fundamentals
- Bachelor, Master, or PhD degree in Computer Science or similar technical discipline (or equivalent)
- Complex system software design and development experience is a plus
- Experience with large-scale web service, cloud, Big Data, and/or machine learning is a plus
- 5-7 years of Software Development experience building large scale distributed data processing systems/applications or large scale internet systems
Data Software Engineer Job Description
- Coordinate, communicate and reinforce technical direction with the development team
- Develop high quality, scalable, secure, stable code for use in products and solutions for customers, making it easier for other developers to maintain, enhance and reuse
- Apply continuous attention to technical excellence and good design, resulting in a straightforward solution and reducing complexity
- Develop and maintain Unit Tests
- Ensure new code follows best security practices
- Participate in code reviews to ensure new code conforms to standards
- Interact with customers to identify and resolve product defects
- Test newly developed features to ensure they are functioning properly
- Ensure new code, feature or software product meets performance goals/metrics
- Research and resolve defects logged by customers or QA and document all changes made
- Must have prior data integration experience
- Experience with data modeling (able to read and support an ERD)
- Minimum of 5 years of experience working with various data management systems, physical database design, testing, implementation, maintenance and support
- Stays abreast of emerging technology and integration into operational best practices
- Software Development Experience - 3+ Years (Java)
- Data Virtualization tools - 1+ years (Denodo, Cisco, RedHat/JBoss)