Big Data Job Description
Big data
provides software expertise in these areas: Java application integration, java enterprise services, microservice architecture, data analysis, or Spark.
Big Data Duties & Responsibilities
To write an effective big data job description, begin by listing detailed duties, responsibilities and expectations. We have included big data job description templates that you can modify and use.
Sample responsibilities for this position include:
Knowledge of python & Big Data will be bonus
Data extraction, transformation and ETL using DQL Server, Teradata, Hadoop
Self Starter that is able to work independently and multitask under short deadlines based on general directions
Help to establish processes, methodologies and benchmarks for analytics
Formulate individual analysis plans, determine the data requirements from both internal and external systems, extract and manipulate the data, conduct analyses, determine the conclusions and communicate to senior management and to the working team in a concise, organized fashion
Effectively work with cross-functional teams and/or with various departments
Proactively work with business users and source system analysts to understand and gain expertise in business process and data relationships
Analyze customer requests for feasibility
Facilitate requirements elicitation sessions and walkthroughs with business and IT resources
Evolve into a subject-matter expert who can easily liaise between Data Analytics and other departments
Big Data Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Big Data
List any licenses or certifications required by the position: AWS, GCP, SNS, SQS, API, S3, COMPTIA, PKI
Education for Big Data
Typically a job would require a certain level of education.
Employers hiring for the big data job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Technical, Information Technology, Information Systems, Mathematics, Statistics, Math, Computer Engineering, Business
Skills for Big Data
Desired skills for big data include:
Spark
Hive
SQL
Java
Python
Application
Data and infrastructure architecture disciplines
Testing
Code reviews
Build processes
Desired experience for big data includes:
Coordinate tactical-related business requests for Data Analytics development enhancements
Ability to analyze large volume of data and identify patterns
Must be able to work in high-stress environment with constantly shifting priorities
Experience in interviewing business users, collecting and interpreting requirements, explaining the solution details to business audience and run business meetings
Proficient in modeling / mapping as-is and to-be business processes
Demonstrated the ability to manage multiple, concurrent projects, activities and tasks under time constraints
Big Data Examples
1
Big Data Job Description
Job Description Example
Our innovative and growing company is searching for experienced candidates for the position of big data. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for big data
- Define data standards for use across the ERS technology stack
- Assist in the transformation of high volume complex data structures into relevant information that can be used by Data Scientists, BI Analysts, and detection systems
- Work closely with product planning and business stakeholders to help define the strategy to best meet our customers’ needs
- Become an expert on system architecture, functionality, and data flows operations processes and tools
- Evangelize ERS Data Engineering products to data consumers
- Evaluate and make recommendations on changes in upstream technologies and assess impacts to data
- Effectively manage trade-offs between effort/schedule and customer benefits
- Collaborate with Engineers, Data Scientists, System Architects, Product Managers, Analysts, and Production Support Analysts to implement successful solutions
- Understand and manage customer requirements (delivery and environmental factors) to ensure contract understanding and acceptance for deliverables, cost, contract type, timeline, risk and assumptions, and customer satisfaction
- Ensure delivery methodology is understood by team from project initiation to project closeout
Qualifications for big data
- Strong experience with the Atlassian JIRA, Jenkins, Stash and Confluence
- Must possess abilities in Microsoft Excel, PowerPoint, and Word
- 5-10 years as a power user of traditional BI tools – Business Objects, Microstrategy, Cognos
- 3-5 years of experience on leading analytic technologies – Tableau, Platfora, Mixpanel, Qlik
- Hungry to learn new technology – Big Data, Hadoop, A deep desire to be more techie
- Deep understanding of Apache Hadoop 1/2 and the Hadoop ecosystem
2
Big Data Job Description
Job Description Example
Our innovative and growing company is looking for a big data. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for big data
- Mentor, manage and develop product/project team members
- Build and deliver compelling customer focused demonstrations
- Identify and implement areas for continuous process improvement
- Research, experiment and prototype new software technologies and concepts to improve our data lake and data model
- Ensure best practices for processing, cleansing, and verifying the integrity of data used for analysis and learning
- Contribute to data mining techniques and applications using state-of-the-art methods
- Working knowledge of Tensorflow or H20 or Scikit or related framework or libraries, along with discrete math concepts
- Collaborating with internal business clients to identify and develop enterprise scale analytic algorithms on large data sets
- Acquiring, curating, and cleaning data from a wide variety sources, both public and private
- Developing and maintaining ETL pipelines and workflows
Qualifications for big data
- Master degree in computer science or related fields
- Expertise in machine learning, graph analytics and text mining techniques, such as classification, regression, clustering, feature engineering, label propagation, PageRank, information extraction, topic modeling
- Kaggle player will be a plus
- Developing models to generate actionable insights that help inform those business decisions
- Making clear, data-driven, and actionable, recommendations to the business on new initiatives and areas for potential improvement
- Presenting data and recommendations in a well-structured, clear, format
3
Big Data Job Description
Job Description Example
Our company is growing rapidly and is looking for a big data. We appreciate you taking the time to review the list of qualifications and to apply for the position. If you don’t fill all of the qualifications, you may still be considered depending on your level of experience.
Responsibilities for big data
- Design and Develop big data solutions using Hadoop and Spark platform
- Selecting and integrating big data tools and frameworks to support the business’ analytics needs
- Provisioning and maintaining cloud based databases and cloud computing environments
- Continuing to grow knowledge of data engineering tools and processes
- Evaluate trends, characterize factors, develop predictive models, and identify optimization opportunities.Provide accurate, timely, relevant and quality analysis that translate data into sound organizational decisions.Research, design and prototype robust and scalable models based on machine learning, data mining, and statistical modeling to answer key business problems
- Define conformed zone LDM/PDM, SLA of the data pipeline RFT Data Services data platform
- Define LDM (Logical Data Model) and/or LAM (Logical Access Model) in the Risk Repository
- Define boundary sets for the data contents RFT plays as System of Records
- Work closely with data engineering/IT/dev teams to architect and engineer solutions that provide solutions around our analytic and big data platforms
- Create and maintain conceptual, logical and physical data models of data assets & resources
Qualifications for big data
- Understanding (and explaining in clear terms) the limitations and nuances of the models
- Experience in software development/ engineering, including requirements analysis, software development, installation, integration, evaluation, enhancement, maintenance, testing, and problem diagnosis/resolution
- Knowledge of Linear Algebra, ability to communicate the results of analyses
- Experience with the data/development architecture in the field of big data specific to Hadoop Zoo
- Hadoop/MapR
- Expertise in big data technologies and principles including architecture, design, data acquisition, data delivery methodologies, and performance optimization in multi-terabyte environments
4
Big Data Job Description
Job Description Example
Our company is searching for experienced candidates for the position of big data. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for big data
- Work with alternative analytic data systems to incorporate them into the operational data flow for the Analytics Teams
- Engage with large functional efforts across multiple projects with minimal guidance including to provide guidance and education to other senior and intermediate contributors within team
- Ensure data flows and related information is being tracked, managed and documented
- Keep current with Big Data technologies in order to recommend best approaches in order to perform current and future work
- Solution - Deliver on-site technical engagements with partners and customers
- Working with RFT Data Services Data Architect/Modeler and up-stream technology partners to define conformed zone LDM/PDM, SLA of the data pipeline RFT Data Services data platform
- Working with RFT Data Services Data Architect/Modeler and down-stream technology partners to define LDM (Logical Data Model) and/or LAM (Logical Access Model) in the Risk Repository
- Ensuring development outputs are suitably integrated into release modules
- The support of the release-to-service process including security and accreditation processes
- Providing Technical advice and expertise on designs, solutions, tools, techniques and standards
Qualifications for big data
- Extensive programming experience in Java, Python or Scala – we’re looking for a coding geek!
- Driven, proactive, and accustomed to working with aggressive project timelines and with a history of delivering high quality technical solutions to data-driven business challenges
- Proficiency in data mining and analysis with intermediate to advanced query skills (ex
- Ability to understand JSON & XML streaming messages and create logical designs for transforming data into queriable structures
- Demonstrated ownership of projects in a technical environment, enabling teams during the software development lifecycle
- Ability to facilitate communication between technical and business stakeholders to ensure functional requirements and technical implementation considerations are understood and accepted
5
Big Data Job Description
Job Description Example
Our company is growing rapidly and is looking to fill the role of big data. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for big data
- Continuously improve software engineering practices by adapting innovative ways
- Works with the teams to plan approach to understand current state architecture
- Contributing data sources, technologies, interfaces, performance issues and system configurations
- Design and analyze data models, data flows, and integration patterns for structural deficiencies/soundness to build a robust and complete future state model
- Create/Review logical entities and define their attributes
- Design physical data models and generate DDLs
- Perform data normalization and denormalization where needed
- Define volumetric and Define access requirements
- Design and deliver data solutions to empower data migration initiatives, BI initiatives, dashboards development
- Differentiate and recommend different tools that can be used to solve business problems
Qualifications for big data
- Experience with Hadoop environment (including Hive, Impala, Sqoop, Spark )
- Talent for working cross functionally to drive the implementation of new features resolve operational issues
- Ability to learn quickly and identify opportunities for improvement
- Bachelor degree in Computer Science, related technical field preferred, or equivalent work experience
- 7 + years Hands on Experience with distributed environments such as HDFS/Hadoop, Cloudera stack-Impala, Sqoop
- 5 + years of experience with Oracle and 2 + years with Impala