Data Architect, Big Data Job Description
Data architect, big data
provides advanced orchestration to support end to end data warehouse and data lake loading.
Data Architect, Big Data Duties & Responsibilities
To write an effective data architect, big data job description, begin by listing detailed duties, responsibilities and expectations. We have included data architect, big data job description templates that you can modify and use.
Sample responsibilities for this position include:
Provide data management expertise to our clients in evaluating requirements and developing data architecture and Big Data solution design
Lead design of our data warehouse analytics cloud infrastructure, amalgamating data from multiple and disparate sources, and working with the development team on implementation
Identify and implement strategies for service enabled technologies
Provide program level data architecture and design expertise on development projects
Proactively drive new approaches and techniques for the Big Data platform propose improvements in software development practices, software quality, and software efficiencies
Work as part of a team, to design and develop Big Data solutions
Lead analysis, architecture, design, and development of data warehouse and business intelligence solutions and using next generation data platforms
Assist business development teams with pre-sales activities and responding to RFPs
Design, Develop, Test, and Deploy Hadoop clusters using any Hadoop distribution & open Source platforms
Analyze, design, develop, test and deploy data driven analytics, event driven analytics, sets of analytics orchestrated through rule engines, analytics that discover and exploit social networks, analytics with heterogeneous data environment
Data Architect, Big Data Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Data Architect, Big Data
List any licenses or certifications required by the position: AWS, TOGAF, RHCSA, DOD, CWAPT, CEPT, CPT, CEH, CREA, CISSP
Education for Data Architect, Big Data
Typically a job would require a certain level of education.
Employers hiring for the data architect, big data job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Technical, Math, Business, Mathematics, Software Engineering, Information Technology, Computer Engineering, Education
Skills for Data Architect, Big Data
Desired skills for data architect, big data include:
AWS Step Functions
Agile development methodologies
Building data orchestration and pipelines leveraging Apache Airflow
Debezium
Lake formation
NiFi
Oracle Goldengate
Streamsets
Advanced integration
Algorithm analysis and optimization
Desired experience for data architect, big data includes:
Hands on experience with Big Data Hadoop technologies such as MapReduce, Pig, Hive, HBase, Flume and NoSQL platforms such as Hbase, MongoDB, Cassandra
Deep first-hand experience building enterprise data warehousing / business intelligence solutions and in-depth knowledge of related concepts
Multiple years of experience as an architect in the data warehousing and BI space (incl
Expert level skill in one, or more, Big Data Technologies such as (BigQuery, Cloudera, Hive, HBase, Kafka, Pivotal, Redshift, Spark, Storm, Vertica, Yarn)
Advanced level skill with ELT/ETL tools
Substantial expertise in Advanced Analytics technologies & solutions (incl
Data Architect, Big Data Examples
1
Data Architect, Big Data Job Description
Job Description Example
Our company is searching for experienced candidates for the position of data architect, big data. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for data architect, big data
- Full time senior development engineering role
- Provide leadership and guidance to project teams and other architects on all aspects of BI / Analytics data architecture (Data Curation needs and methods, normalized and dimensional data modeling, Analytics and Machine Learning Data needs, ETL, reporting)
- Provide guidance and consultation on specific delivery methodologies for BI/Analytics projects, such as technical requirements and model design review
- Work with the Data Modeler’s and Data Scientist (both internal and external) to set strategy and oversee design for significant data modeling and analytics work
- Participates in meetings to review the design of BI / Analytics projects
- Regularly interact with BI / Analytics leadership on project work status, priority setting and resource allocations
- Assist infrastructure leads and BI/ Analytics teams as needed with background and information on all technologies in use for projects such as new version upgrades, migration of hardware, production issues
- Provide leadership and guidance on setting up environments used by the BI / Analytics team so that they are optimized for a leveraged, multi-tenant operation
- 8+ years overall experience in application or solution development or consulting related to application or solution development
- Designing star schema data models
Qualifications for data architect, big data
- BS, or equivalent, in Math, Computer Science or an applied quantitative field
- Hands-on experience in Big Data Components/Frameworks such as Hadoop, Spark, Storm, HBase, HDFS, Pig, Hive, Sqoop, Flume, Ozie, Avro
- Have hands-on experience with Cloudera Hadoop Administration
- Experience with the major big data solutions like Hadoop, MapReduce, Hive, HBASE, MongoDB, Cassandra, Spark, Impala, Oozie, Mahout, Flume, ZooKeeper, Sqoop
- Firm understanding of major programming/scripting languages like Java, Python, R
- Experienced in design and build of enterprise Big Data solutions using modern data technologies (Hadoop, Spark, NoSQL)
2
Data Architect, Big Data Job Description
Job Description Example
Our growing company is looking for a data architect, big data. We appreciate you taking the time to review the list of qualifications and to apply for the position. If you don’t fill all of the qualifications, you may still be considered depending on your level of experience.
Responsibilities for data architect, big data
- Propose innovative technology solutions within the constraints of large-scale enterprises, and take the lead in implementing and evaluating these solutions
- Enable sales opportunities by working closely to the sale executives selling Big Data consulting work
- Innovation to support our clients on how to architect and deliver innovation based on the next generation of Big Data technologies and architectures
- Be a technical thought leader who helps shape both technical direction and process improvements across the Big Data landscape of a client
- Supervise architecture design, infrastructure design, technology build and deployment activities on multiple platforms
- Define and help enforce data governance and security policies in conjunction with delivery teams to setup new Hadoop users
- Assist the Technical Delivery Manager with assigned duties
- 20% Lead conversion planning and forecasting on a weekly, monthly, seasonal, and annual level
- 10% Draw reasonable and actionable conclusions from analytic summaries and recommend changes to existing policies and processes based on analytic conclusions and understanding of business requirements and drivers
- 10% Collaborate with peers to ensure consistency of information, methodologies and reports
Qualifications for data architect, big data
- MSc Degree or equivalent in Software Engineering or similar technical discipline
- Over 10 years of experience in developing Data-oriented solutions
- Strong understanding of Big Data / Hadoop, Infrastructure, RDBMS, Data Warehousing, Analytics, Business Intelligence and Data Integration
- Experience working with Big and/or Fast data processing including environment and deployment models, ingest data pipelines, security and infrastructure
- Knowledge of in-memory data processing techniques
- Sound Java programming skills
3
Data Architect, Big Data Job Description
Job Description Example
Our innovative and growing company is looking to fill the role of data architect, big data. If you are looking for an exciting place to work, please take a look at the list of qualifications below.
Responsibilities for data architect, big data
- Help improve development processes within and between teams
- Explore and gain mastery of multiple systems in order to ensure a cohesive product offering
- Explore and validate new technology platforms to solve business needs
- Code! Stay sharp, collaborate with your peers and deploy code
- Hadoop Ecosystem (map reduce, spark, hbase)
- Analytic Databases (Vertica)
- AWS Ecosystem
- Technical leadership role responsible for developing and maintaining data warehouse and Big Data roadmap ensuring Data Architecture aligns to business centric roadmap and analytics capabilities
- Establish data management and development standards for data warehouse, data integration and Big Data technologies
- Support ongoing data modeling and Integration efforts for all development and production environments including Big Data Design Patterns
Qualifications for data architect, big data
- Knowledge and implementation of cloud based Big Data solutions
- Automated deployment scripting, Ansible, Puppet, Chef
- Experience with statistics, modeling and numerical analysis
- Knowledge of R language
- Must have experience in managing the full life-cycle of a Hadoop solution
- Advanced degree in Computer Science, Computer Engineering, IT, Operations Research, Industrial Engineering, Statistics, Mathematics, or similar technical field
4
Data Architect, Big Data Job Description
Job Description Example
Our company is looking for a data architect, big data. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for data architect, big data
- Provide support for designing and building mission critical, high volume transactions and highly scalable systems across globally distributed data centers
- Leverage expertise in enterprise data modeling, data normalization, key or value pair modeling, use case modeling, business rule design, and storing metadata and data dictionaries within a formal modeling tool
- Unify the Global Insights tech stack into a strategically cohesive and operationally integrated end-to-end product suite
- Partner with key members of the technological organization at Blizzard to ensure the Global Insights team is in lock-step with greater technological initiatives at Blizzard
- Drive ongoing innovation and development to empower the analytics team with a best-in-business analytical data ecosystem
- Define solutions based on stakeholders needs, cost, and required integration with existing applications, systems, or platforms
- Research, identify, test, select, and drive adoption of technology products within the analytical data ecosystem to ensure ongoing best-in-class capabilities
- Contribution to creating, documenting and communicating the overall AVA technical architecture, strategy and roadmap
- Acting as the authority and an (technology) evangelist on current and best practice big data technologies within the Global Services and AVA organization
- Leading and consulting with stakeholders throughout the full lifecycle implementation of customer solutions built on the AVA platform, providing solution designs
Qualifications for data architect, big data
- Experience on working in onshore/offshore model
- A professional, constructive and reliable approach to work
- Hands-on experience with the Hadoop stack
- Hands-on experience with open source software platforms and languages
- Strong Java or Scala development skills
- Extensive experience with cloud hosted applications
5
Data Architect, Big Data Job Description
Job Description Example
Our company is hiring for a data architect, big data. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for data architect, big data
- Manage all activities centered on obtaining data and loading into an Enterprise Data Lake
- Stay current with vendor/product roadmaps and make recommendations for adoption
- Create and tune SQL for views across federated sources including Hadoop, DB2 and Oracle
- Implement data virtualization architecture
- Collaborate with BI report developers on design for optimal performance
- Use business requirements to document clear and concise technical designs
- Maintain design and naming standards
- Contribute to project planning discussions, provide status updates for development progress and be a critical resource for issue resolution
- Designing and implementing modern, scalable data architectures for our clients leveraging Big Data and/or NoSQL technologies, covering on-premise and cloud-based deployment patterns
- Providing advisory services and thought leadership on modernising analytics environments leveraging Big Data technologies, including integration with existing data and analytics platforms and tools
Qualifications for data architect, big data
- Experience in running, using and troubleshooting the Apache Big Data stack Hadoop FS, Hive, HBase, Kafka, Pig, Oozie, Yarn, Sqoop, Flume
- Understand the business need for big data – what kind of data, how much data, types of algorithms to be run, load on the system, budget - and recommend optimal solutions
- Build and implement the solution
- 15+ years experience in IT, with 5+ years in similar role
- 5+ years experience in hands-on large-scale software development/integration using Java/J2EE technologies
- 2+ years hands-on experience Hadoop ecosystem technologies (Hadoop, HDFS, Spark, MapReduce, Pig, Hive, Flume, Sqoop, Cloudera Impala, Zookeeper, Oozie, Hue, Kafka)