Senior Big Data Developer Job Description
Senior Big Data Developer Duties & Responsibilities
To write an effective senior big data developer job description, begin by listing detailed duties, responsibilities and expectations. We have included senior big data developer job description templates that you can modify and use.
Sample responsibilities for this position include:
Senior Big Data Developer Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Senior Big Data Developer
List any licenses or certifications required by the position: AWS
Education for Senior Big Data Developer
Typically a job would require a certain level of education.
Employers hiring for the senior big data developer job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Science, Information Systems, Technical, Mathematics, Software Engineering, Computer, Information Technology, Computer Engineering
Skills for Senior Big Data Developer
Desired skills for senior big data developer include:
Desired experience for senior big data developer includes:
Senior Big Data Developer Examples
Senior Big Data Developer Job Description
- Quickly learn new development languages if required
- Work in a very unstructured environment where activities and tasks change frequently
- Be a strong, committed, reliable team player
- Utilizing the latest technologies available, designing and building data solutions to meet business needs
- Constantly seek out better ways to do things, new tools, new technologies, new processes
- Work on both transformational and BAU projects delivering new value while also maintaining existing processes
- Work as part of a cross functional agile team responsible for end-to-end delivery of business needs
- Utilize DevOps to automate everything
- The individual will provide thought leadership and drive architecture and the design of Big Data Information Management & Analytics solutions
- Ensure alignment of the enterprise architecture and data management strategies with the business strategies and goals
- Java, Core Java, Java EE
- Database - Oracle, DB2, NoSQL
- Strong commercial exposure with Hadoop / Pig / and or Cassandra
- Experience with Lean and/ or SCRUM development methodologies a plus
- Desire to learn, participate on diverse teams on exciting and challenging activities
- You are C# .Net Microsoft Certified or Sun Certified Java Programmer
Senior Big Data Developer Job Description
- Broad based experience in deploying data management solutions
- Identifies creative, technology-based opportunities to improve service, reduce costs, and increase revenues with business partners and vendors
- Work closely with business users at a technical and user level, to design and produce solutions
- Take part in reviews of work
- Become member of a product team that delivers applications to internal users
- Be part of the growing Hadoop community of 35+ specialist
- Design and implementation of software product (BigData related) including data models and visualisations
- Develop Big Data solutions on top of Hadoop and Teradata
- Development, testing and automation of developed solutions
- Write technical documentation including, but not limited to high level architecture diagrams
- You have experience in distributed cache experience
- You are experienced in working within an Agile and or Scrum environment
- Ability to collaborate and share initiatives in developing and innovating technology analytics solutions
- Strong communication & problem management skill
- Knowledge of related open source products, notably Spark, Cassandra, Hadoop
- Knowledge in design patterns and object oriented and functional programming
Senior Big Data Developer Job Description
- Developing server-side applications with Big Data Technologies
- According to requirements and specifications
- Within established or defined quality and performance standards
- Within agreed upon delivery timelines
- If required, to lead a small team of Developers to work on development projects
- Participate in consultation with Development Leads in estimating effort for work assigned
- Participate in initiatives that improve processes and/or procedures that contribute to performance effectiveness and efficiencies
- Communicate work progress and all (work related) pertinent information in an accurate and timely manner to the Development Leads
- Possess a Degree in Computer Science, Software Engineering or equivalent
- At least 5 years of working experience in a commercial software development environment with at least the last 2 years in a senior technical position
- Experience with state of the art development tools (Git, Gerrit, Bugzilla, CMake, Maven, Docker, …)
- Programming experience in Node.js
- At least 1+ years hands on Java development experience is required
- Development of algorithms using Scala, Python, Java on ML platforms such as Spark, H20
- High throughput (750k requests per second) at low latency (10s of ms)
- TBs of data moving across our data pipeline every hour
Senior Big Data Developer Job Description
- Linux (Usage and Administration)
- Familiar with Open Source tools / Frameworks
- Software as a Service (SaaS) platform
- NoSQL databases, such as HBase, Cassandra, MongoDB • Performance and automated testing of Web Services
- The Data Engineer will design and develop components of big data processing, as part of an agile/scrum team
- The Data Engineer will help plan and implement methods to scale our product further
- Deploy and manage EMR, Redshift, and Dynamo DB services based applications on AWS
- Write regression tests for your own code using different programming languages
- Docker and Kubernetes
- Data pipeline engine
- PBs of data constantly churning on our analytics platform
- Rapidly expanding global footprint
- Fast paced Ad tech, big data at massive scale ecosystem
- Masters in Mathematics, Physics, Computer Science or Informatics
- At least 7 years of professional experience outside academia
- Strong in mathematics and statistics
Senior Big Data Developer Job Description
- Knowledge in MariaDB, or at least should have knowledge in RMDB (e.g, MySQL, Oracle)
- Preferable to have knowledge in Private Cloud platform (Openshift, Kubernetes, Docker)
- Familiar with Agile practice, especially to the Scrum Master role
- Establish Continuous integration and Release automation
- Good to know any Machine Learning technologies, models
- New application development and production application support
- Analyze, design, develop, test, and implement distributed applications as part of a systems development team
- Provide feedback on and adhere to delivery dates
- Design, develop and implement advanced algorithms and data pipelines that extract, classify and merge structured and unstructured data from multiple sources
- Participate in requirements and design workshops with our onshore team and clients
- At least four years of professional experience outside academia
- Must have 2+ years of experience with REST or Web Services API development
- Experience with Social Media API level interactions
- Other Tech
- Bachelor's degree in Computer Science, Telecommunications, Electrical Engineering or related field preferred
- Very strong Unix/Linux skills