Hadoop Administrator Resume Samples
4.6
(117 votes) for
Hadoop Administrator Resume Samples
The Guide To Resume Tailoring
Guide the recruiter to the conclusion that you are the best candidate for the hadoop administrator job. It’s actually very simple. Tailor your resume by picking relevant responsibilities from the examples below and then add your accomplishments. This way, you can position yourself in the best way to get hired.
Craft your perfect resume by picking job responsibilities written by professional recruiters
Pick from the thousands of curated job responsibilities used by the leading companies
Tailor your resume & cover letter with wording that best fits for each job you apply
Resume Builder
Create a Resume in Minutes with Professional Resume Templates
CHOOSE THE BEST TEMPLATE
- Choose from 15 Leading Templates. No need to think about design details.
USE PRE-WRITTEN BULLET POINTS
- Select from thousands of pre-written bullet points.
SAVE YOUR DOCUMENTS IN PDF FILES
- Instantly download in PDF format or share a custom link.
LH
L Hahn
Lambert
Hahn
90550 Euna Parks
Dallas
TX
+1 (555) 765 6050
90550 Euna Parks
Dallas
TX
Phone
p
+1 (555) 765 6050
Experience
Experience
Boston, MA
Hadoop Administrator
Boston, MA
Bahringer, Stoltenberg and Jakubowski
Boston, MA
Hadoop Administrator
- Establish and maintain a configuration management and change management system for controlling work products
- Assist application development teams during application design and development for highly complex and critical data projects
- Assist development team in identifying the root cause of slow performing jobs / queries (HDFS)
- Develop tools and utilities to administer Hadoop jobs, manage queues and monitor performance
- Responsible for people Management, including goal setting and providing performance feedback
- Work with IT Service Management and other groups and make sure that all events, incidents and problems are resolved as per the SLA
- Monitor running applications and provide guidance for improving DB performance for developers
Boston, MA
Hadoop Administrator Consultant
Boston, MA
Kemmer-Yundt
Boston, MA
Hadoop Administrator Consultant
- Conduct performance tuning and capacity management
- Screen Hadoop cluster job performances and capacity planning
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines
- Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting
- Manage and review Hadoop log files
- Performs root cause analysis on failed components and implements corrective measures
- File system management and monitoring
present
Phoenix, AZ
Senior Hadoop Administrator
Phoenix, AZ
Luettgen-Bayer
present
Phoenix, AZ
Senior Hadoop Administrator
present
- You will work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services
- Coordinate with Development, Network, Infrastructure, and other organizations necessary to get work done
- Manage several Hadoop clusters in development and production environments
- Cluster maintenance as well as creation and removal of nodes using tools like Ganglia,Nagios,Cloudera Manager Enterprise, Dell Open Manage and other tools
- Manage Hadoop environments and perform setup, administration, and monitoring tasks
- Perform other work related duties as assigned
- Perform analysis and provide input to support capacity planning and solution design decision
Education
Education
Bachelor’s Degree in Computer Science
Bachelor’s Degree in Computer Science
Rutgers University
Bachelor’s Degree in Computer Science
Skills
Skills
- Strong UNIX/Linux knowledge including the ability to understand the interaction between applications and the operating system
- Ability to quickly learn new technologies and enable/train other analysts
- Good work ethics with extremely high standard of code quality, system reliability, and performance
- Excellent communication skills, with strong verbal and writing proficiencies
- Demonstrated ability to quickly learn new languages and tools
- Strong analytical competencies and excellent creative problem-solving skills
- Ability to quickly learn new technologies and adapting to new environments
- Superb communication skills, with strong verbal and writing proficiencies
- Ability to work independently as well as in a team environment on moderate to highly complex issues
- Responsible for cluster availability and available 24x7 on call support
8 Hadoop Administrator resume templates
Read our complete resume writing guides
1
Hadoop Administrator, Mid Resume Examples & Samples
- 4 years of experience with Linux systems administration
- 2 years of experience with Hadoop systems administration
- 2 years of experience with Big Data operations and maintenance, including developing and implementing change plans
- 1 year of experience with operation of a virtual environment using hypervisors, including Virtual Box or KVM
- 1 year of experience with using Puppet to automate systems administration tasks-Active TS/SCI clearance
2
Hadoop Administrator Consultant Resume Examples & Samples
- File system management and monitoring
- Participate in and contribute to the implementation of best industry practices
- Contribute to architecture and capacity planning activities
- Conduct performance tuning and capacity management
- Performs root cause analysis on failed components and implements corrective measures
- Provides ongoing information to leadership, customers, and peers regarding enhancements, innovations and solutions
- Responsible for following company specific systems engineering standards
3
Lead Hadoop Administrator Resume Examples & Samples
- Perform ongoing capacity management forecasts including timing and budget considerations
- 1-2 years of experience in deploying and administering Hadoop Clusters
- Good knowledge of Hadoop cluster connectivity and security
- Development experience in Hive, PIG, Sqoop, Flume, and HBASE desired
4
Senior Hadoop Administrator Resume Examples & Samples
- Monitoring and troubleshooting of hardware and software services
- Install new software releases, system upgrades, patches, and evaluation of stability
- Tuning of servers, applications and Hadoop infrastructure
- Work with users, engineering groups, and vendor support for troubleshooting
- Keep up on emerging technologies relevant to our needs
- Focus on process automation and documentation of processes and troubleshooting guides
- Ability to effectively work with systems and network staff for hardware upgrades and issues
- Experience with ETL and BI tools
- Experience with the Cloudera hadoop distribution
- Experience with Hive, MapReduce, YARN, Oozie, Sqoop, Flume, HBase, Impala, MySQL, Postgres, etc
- Certified Hadoop Administrator (Cloudera, Hortonworks, etc.)
5
Hadoop Administrator Resume Examples & Samples
- Diagnose, assess, troubleshoot and fix issues within the Open Source environment
- Performance tuning, resource and capacity management of users and scheduled jobs
- Enforce security compliance and BI governance rules
- Documentation of all environmental settings and configurations
- Planning and upgrading of the environment, both hardware and software (where applicable)
- Provide front line support to teams using the Hadoop environments
- Ensure availability and stability of the systems in production
- Along with the rest of the team, actively research and share learning/advancements in the Hadoop space, especially related to administration
- Experience using the Hadoop tool set such as Sqoop, Oozie, Flume, Yarn, etc. (3+ years)
- Strong UNIX/Linux skills. (5+ years)
- Knowledge of Hadoop architecture and the evolving role of Hadoop in the Enterprise environment
- Experience with any of the above responsibilities or Cloudera specific tools is required [preferred]
- Experience in deploying a Hadoop environment
- Knowledge of Hadoop related coding languages (Map Reduce, Java)
6
Linux & Hadoop Administrator Resume Examples & Samples
- Working in a fast-paced analytics environment
- Responsible for designing, developing, testing, debugging and deploying high performance, real-time, distributed analytics solutions and use cases using technologies such as Linux, VMWare, Hadoop, Flume and NoSQL
- Install, configure, and administer Linux servers from scratch
- Install and fully configure multi-node production-level Hadoop clusters
- Develop, design, and manage Map/Reduce jobs
- Design and implement data preparation and ETL jobs
- Design, develop, test, debug and deploy the integration and ingestion of various data sources into Hadoop
- Install Analytics applications
- Perform integration of Analytics platforms to external reporting and visualization tools
- Map design artifacts to system requirements
- Participate in design discussions and author design documentation
- Lead the project and manage and guide teams as Lead Solution Integrator
- BS/MS degree in Computer Science, Electrical Engineering or Management Information Systems or acceptable equivalent
- Experience designing and integrating IT technology solutions
- More than 5 years experience working as Linux/UNIX System Administrator installing and managing Linux servers
- Experience with server virtualization tools such as VMWare
- At least 2 years experience installing multi-node production Hadoop environments
- Deep hands-on working knowledge of MapR Hadoop distribution
- At least 2 years experience with data injection tools such as Flume and Sqoop
- Experience with Map-Reduce algorithms, Pig and Hive programming for Hadoop
- Experience with Analytics visualization tools such as Splunk, Tableau, Microstrategy is an added advantage,
- Knowledge of analytics platforms such as HP Vertica, Greenplum, Teradata is a plus
- Good knowledge of database security and policy control
- Quick learner with a passion for designing, implementing and deploying data analytics solutions
- Excellent oral and written communication, presentation, and analytical skills
7
Hadoop Administrator Resume Examples & Samples
- Worked on setting EC2 cluster like instances, VPC, Subnet, Elastic IP’s
- Set up Cloudera 5 Hadoop cluster and worked on end to end implementation
- Working in Hadoop and Hive for multi node cluster
- Worked with ETL architect to develop ETL design
- Created Mapping documents, Design documents, Test cases, Analysis documents
- Demonstrated skills in DWH and Extensive experience in Oracle Warehouse Builder
- Documented business rules, functional and technical designs, test cases, and user guides
- Expert in Data warehousing, metadata management and enterprise architecture
8
Hadoop Administrator Resume Examples & Samples
- Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
- Should have leadership skills to manage the team on 24x7 basis in highly business critical environment
- Having the exposure to telecom environmment will be an advantage
9
Hadoop Administrator Resume Examples & Samples
- Excellent knowledge of Hadoop architecture, administration, and support, including HDFS, Zookeeper, MapReduce, YARN
- Experience with Hadoop Ecosystem Security (Kerberos, AD integration, and/or other ecosystem components such as Ranger, Knox, Rhino, Falcon, etc.)
- Responsible for upgrades, installations, systems management of Hadoop & related utilities
- Minimum of 5+ years IT experience and 2+ years Hadoop skills required
- Strong Linux System Administration skills (RHEL/CentOS preferred)
- Experience with monitoring and alert notification in a Hadoop production environment
- Develop, manage and implement backup and recovery processes
- Scripting skills for Administration and ETL/ELT processing (e.g. Shell, Python, Java, SQL, etc.)
- Work closely and collaboratively in an agile environment with our Big Data Infrastructure and Development teams to analyze issues
- Understanding and ability to participate in all phases of the SDLC including requirements gathering, business analysis, configuration management and quality control
- Bachelor’s degree in Information Science / Information Technology, Computer Science, Engineering, or a related field
- Hadoop Administration certification is a plus
- Experience with Amazon AWS and AWS technologies such as EMR, EC2, IAM, S3, Lambda, Data Pipeline, etc. are a strong plus
- Experience with Oozie, Sqoop, Flume, Falcon, Kafka, Storm, Spark and/or other Hadoop Ecosystem components are a plus
- Experience in ETL/ELT workflow management
- Experience with Big Data database components such as Hive, Pivotal Greenplum/HAWQ, AWS Redshift, and/or AWS DynamoDB is a plus
10
Senior Hadoop Administrator Resume Examples & Samples
- Manage Hadoop environments and perform setup, administration, and monitoring tasks
- Perform analysis and provide input to support capacity planning and solution design decision
- Configure and tune environment and batch jobs to ensure optimum performance and 99.99% availability
- Troubleshoot system issues and quickly identify solutions to eliminate impact to business customers
- Coordinate with Development, Network, Infrastructure, and other organizations necessary to get work done
11
Hadoop Administrator Resume Examples & Samples
- 10+ years of relevant experience
- Knowledge of Data Warehousing concepts and technologies in Big Data
- Production support experience in Data Warehousing with exposure to working on onshore offshore model
12
Hadoop Administrator Resume Examples & Samples
- Troubleshoot ongoing Hadoop issues as part of Support
- Participate in weekly rotating on-call responsibilities, providing 24/7 coverage with rotation shifts
- Assist other departments in engineering for hadoop components deployments and release
- Documenting of ongoing operation activities over collaboration tools
- Capacity planning for large node hadoop clusters and analysis
- Education:BE/B.Tech,MCA,MCS
- Total experience should be min.5+ years
- Should have min. 2+ years of experience in Hadoop Administration
- Good hands on experience on Hadoop administration and troubleshooting
- Working knowledge of Kafka , Hive, Pig, Hbase, MapReduce
- Good knowledge of Linux administration
- Must know basic bash/shell scripting
- Good theoretical knowledge of java tuning
13
Hadoop Administrator Resume Examples & Samples
- This position will be responsible for implementation and support of the Enterprise Hadoop environment, including; design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration
- The administrator consultant will work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels
- The administrator consultant will apply a strong understanding of Hadoop eco system such as HDFS, YARN, Map Reduce, HBase, Zookeeper, Pig, Hadoop streaming, and Hive
- The administrator consultant will have experience in installing, administering, and supporting Windows and Linux operating systems /hardware in an enterprise environment. (Ex. Suse/RHEL)
- Expertise in system administration and programming skills. Storage, performance tuning and capacity management of Hadoop clusters and Hadoop MapReduce routines
- Experience in setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level
- The administrator consultant will have broad implementation, administration and configuration experience of Hadoop Ecosystem and MPP systems for large scale custom and packaged applications in big-data environments
- Solve production problems when needed 24x7 Develop and document best practices
- Three to five years’ (or more) experience as Hadoop administrator in a large production environment
- A deep understanding of Big Data, Hadoop Architecture and YARN/Map Reduce concepts
- Prior experience in High Availability techniques, Hadoop cluster connectivity and tuning, network requirements, failover, active-active
- Strong experience in HDFS support, maintenance, backup, restore, disaster recovery, failovers management and troubleshooting
- Experience with Hadoop distribution and Hortonworks Ambari to install, configure and monitor Hadoop clusters
- Good verbal and written communication skill
- Demonstrated experience in working on large projects or small teams
- Working knowledge of Windows and Linux operating systems
- Working knowledge and experience with Java programming language
- Proficient with Java development
- Strong SQL Access/DB2 knowledge
- Expertise in writing shell scripts, Perl scripts and debugging existing scripts
- Ability to quickly learn new technologies and enable/train other analysts
- Ability to work independently as well as in a team environment on moderate to highly complex issues
- High technical aptitude and demonstrated progression of technical skills - continuous improvement
- Experience in the Financial and banking industry
- Hardware infrastructure
- System software infrastructure
- Problem management
14
Hadoop Administrator Resume Examples & Samples
- Create and enhance analytic platforms & tools that enables state of the art, next generation Big Data capabilities to analytic users and applications
- Administrator for Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig
- Assist application development teams during application design and development for highly complex and critical data projects
- Administer open source solutions into the data-analytic ecosystem
- Develop fast prototype solutions by administrating various open source components
- Operationalization of open source data-analytic tools for enterprise use
- Building efficient data platform for structured and unstructured data
- Administrator of distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and Kafka
- Administrator of data management and governance tools on an open source framework
- Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilities
- Experience with Hadoop in AWS
- Industry experience in Financial Services or other regulated industries
- Experience in either developing software or developing code for data movement
- Experience with solving problems and delivering high quality results in a fast-paced environment
- 1+ year administrator experience with the various tools & frameworks that enable capabilities within the data ecosystem (Hadoop, Kafka, , NIFI, Python, Hive, Tableau, MapReduce, YARN, Pig, Hbase, NoSQL)
15
Hadoop Administrator Resume Examples & Samples
- Translates senior-level user-defined capabilities into system/product requirements. Works with more experienced technology specialists to understand business rationale and client expectations
- Assesses the feasibility of requirement implementation and makes informed recommendations to management. Suggests mutually agreeable alternatives, when applicable
- Implements agreed upon solutions to documented business needs. Customizes (recodes) standard third-party vendor products to comply with business needs
- Evaluates success of product modification and regularly monitors performance to ensure ongoing utility. Resolves complex issues as they arise
- Integrates third-party products into the Vanguard environment, frequently with the collaboration of Systems Integration teams. Evaluates vendor products with respect to technical requirements to fill business capability needs, product maturity, and integration complexity
- Provides subject matter expertise in assigned projects through all phases of the development lifecycle. Defines field of use, standards, and best practices around assigned products and technologies
- Supports assigned products by responding independently to client inquiries and resolving issues of greater complexity. Provides technical guidance and mentoring to less senior crew
- Undergraduate degree in a related field or an equivalent combination of training and experience
- Minimum five years experience in application design, architecture and development. Understanding of software engineering processes and system development life cycles
- Expert systems experience with Hadoop (e.g. HDFS, Hive, Impala, Oozie, YARN, Sqoop, Zookeeper, Flume, Spark, Kafka etc.)
- Experience with Cloudera Manager and administrating an installation
- Expert level experience with Linux, Java, shell scripting, and SQL
- Strong problem solving skills and capability to understand and set direction for complex technology integration
- Strong teamwork skills and capability to lead teams
- Knowledge of the financial services industry a plus
- Knowledge of python, ksh, bash a plus
16
Hadoop Administrator / Cloudera Distribution Resume Examples & Samples
- Design proper Hadoop Cluster environments for application and data consumption
- Design and implement automation using scripts, must be proficient in scripting
- Design and implement replication and backups for mission critical/tier-1 applications
- Recommend and implement in depth tuning for infrastructure and applications
- Understanding of the HDFS file system and its methods of replication
- Consults with the DBA staff and Technical Support groups in the tuning and upgrading of database management system software
- Confers with and advises others in the use and applicability of database systems and supporting products
- Creates database schemas and sub-schemas to support the logical database model. Develops, monitors, and maintains backup and recovery for all assigned databases
- Projects long-range requirements for database administration and design in conjunction with other managers in the information systems function
- Minimum of three (3) years experience designing, developing and administering the Cloudera distribution of Hadoop
- Two years experience with cross-platform database network communication techniques INDBBTIT
17
Hadoop Administrator Poly Resume Examples & Samples
- Maintains system documentation
- Develops and monitors policies and standards for allocation related to the use of computing resources
- Oversees implementation of testing strategies and documentation of results
- Provides guidance and work leadership to less-experienced staff members, and may have supervisory responsibilities
- 10-15 years of directly related experience in systems administration and analysis
18
Senior Hadoop Administrator Resume Examples & Samples
- Manage large scale Cloudera Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring
- Evaluate and recommend systems software and hardware for the enterprise system including capacity modeling
- Lead troubleshooting on Hadoop technologies including HDFS, MapReduce, YARN, Hive, Pig, HBase, Sqoop, and Spark
- Work with core production support personnel in IT and Engineering to automate deployment and operation of the infrastructure
- Ability to work with and as a member of the IT O&M group as required to refine our Production capabilities: testing, kernel issues, compatibility and deployment of new versions of custom software
- Identify hardware and software technical problems, storage and/or related system malfunctions
- Creation of metrics and measures of utilization and performance
- Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure
- Assist in monitoring the Linux community and report on important changes/enhancements to the team
- Ability to work well with a national team of highly motivated and skilled personnel - interaction and dialog are requisites in this dynamic environment
- Research and recommend innovative, and where possible, automated approaches for system administration tasks. Identify approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues
- Perform other work related duties as assigned
- 8-10 years of related systems engineering experience
- 4+ years of administrator experience on Big Data Hadoop Ecosystem and related technologies (Sqoop, Hive, Pig, Flume, etc.)
- 7+ years of professional experience supporting production medium to large scale Linux environments
- A deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance
- BI Tools experience a plus
- Expert experience with at least one if not most of the following languages; python, perl, ruby, or bash
- Solid ability to create automation with Chef, Puppet, Ansible or a shell
- Good collaboration & communication skills, the ability to participate in an interdisciplinary team
- Strong written communications and documentation experience
19
Hadoop Administrator Resume Examples & Samples
- 5+ years large scale Hadoop implementation and architecture experience
- Hands on experience with and strong understanding of File ACLs
- Backup/Recovery experience
- Experience with and knowledge of Hadoop technologies including
20
Linux Hadoop Administrator Resume Examples & Samples
- System administration and troubleshooting
- Coding and developing in Hadoop; No-SQL and BI software services at all phases of the SDLC
- Upgrades on servers and firmware
- Monitor and manage Hadoop system performance
- Build and configure Hadoop Servers
- Teradata and Big Data System Admin
- Teradata and Big Data software service creation and management
- HW/SW Configuration and installation
- 2nd Level Support
- Capacity Forecasting
- Product evaluation
- Roadmap planning
- Bachelor’s degree in Computer Science or related area and/or 2+ years of experience in administration
- Demonstrated Technical knowledge of the Software Development Lifecycle phases, including system analysis, design, coding, testing, debugging and documentation
- Demonstrated Technical knowledge of computing software, hardware and networking infrastructure
- Demonstrated Technical (e.g. programming) and/or analytical skills, including the ability to understand and communicate complex technical information
- PC literacy, including desktop applications competency (e.g., Microsoft Office, e-mail, etc.)
- Strong knowledge of information systems concepts
- Working knowledge of applicable methodologies, tools, standards and procedures
- Critical thinking, decision-making and leadership aptitudes
- Good organizational and problem solving abilities
- Teamwork, collaboration, and interpersonal skills
- Certification(s): RHEL Linux
- Knowledge/Experience with Horton works
21
Hadoop Administrator Resume Examples & Samples
- Monitor cluster health and perform tuning activities
- Perform capacity planning and expansion activities working across infrastructure and other enterprise services teams
- Perform cluster maintenance with patching/upgrades/migration, user provisioning, automation of routine tasks, and re-processing of failed jobs
- Configure and maintain security policies
- Install and configure the Hadoop ecosystem tools, including Spark, Kafka, Rabbit, ELK, and Neo4J
- Work with development teams to assist in code promotion across environments and deployments in production
- Experience in the financial services and retail industries
- Experience collaborating with teams of internal and external technical staff, application teams, software support, and operations staff
- Excellent interpersonal skills in areas such as teamwork, facilitation, and presentation to management teams
- Experience with Agile project management methods and practices
- Demonstrated ability to quickly learn new languages and tools
22
Hadoop Administrator Resume Examples & Samples
- 4+ yrs Experience with large scale Hadoop environments build and support including design, capacity planning, cluster set up, performance tuning and monitoring
- Strong understanding of Hadoop eco system such as HDFS, MapReduce, HBase, Zookeeper, Pig, Hadoop streaming, Sqoop, oozie and Hive
- Deep understanding and experience with Cloudera Hadoop stack
- Experience with disaster recovery and business continuity practice in hadoop stack
- Experience in installing, administering, and supporting Linux operating systems and hardware in an enterprise environment
- Expertise in typical system administration and programming skills such as storage capacity management, performance tuning
- Proficient in shell and perl, python scripting
- Experience in setup, configuration and management of security for hadoop clusters
- Manage and monitor Hadoop cluster and platform infrastructure
- Automate cluster node provisioning and repetitive tasks
- Manage Hadoop stack support run book
- Responsible for cluster availability and available 24x7 on call support
- Support development and production deployments
- BS/MS degree in Computer Science or a related field
- Minimum 4 years of experience in Hadoop and related technology stack
- Cloudera Certification and IMPALA support experience is a plus
- Strong software development or scripting skills - Java development a plus
- Strong knowledge and experience in supporting Linux environments
- Good understanding of ETL processes
- Experience maintaining, troubleshooting and setup large clusters
- Experience supporting systems with 24X7 availability requirement
- Thorough knowledge of current hardware systems commonly used in production environments
- Ability to proactively identify, troubleshoot and resolve live systems issues
- Technical documentation skill on supported application and Operational tools
- Strong knowledge in open source monitoring tools and Hadoop monitoring tools
23
Hadoop Administrator / Developer Resume Examples & Samples
- Perform routine and advanced Hadoop and related technologies application development and administration
- Installation/upgrade/configuration of the Hortonworks Hadoop platform
- Perform cluster maintenance with patching, backup/recovery, user provisioning, automation of routine tasks, troubleshooting of failed jobs, configure and maintain security policies
- Interface with other developers
- Maintain documentation and provide user support for developed solutions
- Bachelor's Degree in Computer Science or related field and 10 years of industry experience in a hands-on system deployment and administration environment with strong multi-application support experience (4 additional years of experience may be substituted in lieu of Bachelor's Degree) OR a Master's Degree and 8 years of related industry experience
- 2 years of experience in Big Data, Hadoop and Hadoop-ecosystem in a Linux environment
- Experience in design and deployment of system architecture with broad understanding of the components of Hadoop and Hadoop-ecosystem architecture
- Experience in architecture, deployment, integration and administration with enterprise-scale solutions
- Experience with one or more of the following Hadoop distributions: Apache, Hortonworks, Cloudera, Pivotal HD, or MapR
- Experience in design and implementation of security for Hadoop and Hadoop eco-system applications
- 3 years of experience in software development including Java/J2EE development experience
- Worked in building the monitoring environment for the Hadoop cluster using vendor provided tools and open source tools
- Experienced in anticipating problems and taking decisive action, to solve the issues with minimal impact on both development and production environments
- Ability to relay and receive information both verbally and written, including communicating with customer during the requirements planning stage
- The ability to obtain a Public Trust Security Clearance, U.S. Citizenship or Lawful Permanent Resident (LPR) status required
- Redhat Linux system administration and deployment experience
- Cloudera Hadoop Certified Administrator certification
- Broad range of other COTS product system deployment experience
- Software development experience in Java, Python, C/C++ or C# is beneficial
- Experience in virtualization and Big Data programming using Hadoop, Pig, Hive, and Sqoop with experience in integrating these technologies into existing enterprise environments
- Big data experience with Java MapReduce, Pig, Hive, Spark, Impala and integrating those programs with legacy environments
- Machine Learning Analytics – algorithms, use and implementation
- Experience working in Agile development environments
- Experience in financial industry
24
Hadoop Administrator Resume Examples & Samples
- 1 year experience designing and implementing scalable data platforms
- Experience deploying and scaling Hadoop Infrastructure
- Experience programming with two of the following: Java, Perl, Python
- Experience installing, configuring Linux based systems
- Experience scripting for automation and coding management with one of the following: Chief Puppet)
- Experience with Hadoop and its ecosystem – one of the following: Hive, Pig, Spark, Flume, Zookeeper
- Experience in Installing, Configuring, administering and operating Hadoop clusters
- Experience in providing on-call service coverage within a larger group
25
Linux Hadoop Administrator Resume Examples & Samples
- 5+ years Linux or Unix System Administrator experience
- 3+ years Hadoop administration experience in the area of setup, configuration, or management
- 11+ years in Networking
- Kerberos and Active Directory
- Identity Management
- Cloudera Navigator
- Apache Sentry
- Data Encryption
- Design and implement data storage, schema and partition system as appropriate to Hadoop
- Identify, assess, and recommend appropriate solutions to advice customer on cluster requirements and any limitations by applying industry best-practices and expertise regarding emerging technologies, risk mitigation, and continuity planning to address back-up and recovery
- Provide enterprise-level information technology recommendations and solutions in support of customer requirements
- Securely integrating Kerberos accounts with Active Directory
- Utilizing Identity Management in integrated manner with Active Directory
- Configuring Cloudera Navigator to perform audit operations
- Configuring Apache Sentry to work in Cloudera environment to perform authorization operations
- Configuring encryption on Hadoop data at rest and data in transit
- Use customer defined data sources and prototype processes to satisfy proof of concept
- Develop design patterns for specific data processing jobs
- Test various scenarios for optimized cluster performance and reporting
- Prepare and deliver presentations to communicate deployment process for the proof of concept
- Serve as a point of contact between internal and external customers and program management
- Ensure accurate documentation of technical specifications
26
Architect Hadoop Administrator Resume Examples & Samples
- Design and build high-scale, batch and real-time data processing pipelines using Big Data technologies including Hadoop, Spark, Kafka and relevant platforms
- Perform data analysis to generate business insights
- Build, verify and deploy machine learning models
27
Big Data / Hadoop Administrator Resume Examples & Samples
- At least 1 year of experience with big data technologies such as Hadoop Hive, MongoDb, or other NoSQL based data stores
- At least 1 year of experience with Big Data Infrastructure Architecture required
- At least 1 year of experience working with Hadoop ecosystem. Cloudera, Hortonworks or Mapr preferred
- At least 1 year of experience working in Spark SQL
28
Hadoop Administrator Resume Examples & Samples
- Bachelors degree and Minimum 10 years relevant IT experience. Additional experience may be substituted for degree
- Experience developing with Java in a Linux environment
- Minimum of three (3) years experience designing, developing and administering the Hortonworks distribution of hadoop
- Experience with Sqoop and Flume
- Experience with the design & development of applications for use in distributed computing environments
- Experience with design, development, and testing in cloud technology architectural components supporting analytic modernization
- Must be able to obtain a position of public trust security clearance
29
Senior Hadoop Administrator Resume Examples & Samples
- Solid administrative knowledge of Apache Hadoop a must (Cloudera distribution a plus)
- Bi Tool integration with Hadoop
- DBA experience HBASE
- Design, install, and maintain highly available systems (including monitoring, security, backup, and performance tuning)
- Automation experience (chef/puppet)
- Must possess good analytics and problem solving skills
30
Think Big Hadoop Administrator Resume Examples & Samples
- Experience in managing and supporting large scale production Hadoop environments in any of the Hadoop distributions (Apache, Teradata, Hortonworks, Cloudera, MapR, IBM BigInsights, Pivotal HD)
- 2+ years of experience in Linux shell scripting (Bash, Csh, etc.) and basic SQL
- Experience on administrative activities on Linux systems like
- Management of data, users, and job execution
- Periodic backups of the system
- Plan for and support hardware and software installation and upgrades
- You should be ready to work in shifts and be on on-call support occasionally
31
Cloudera Hadoop Administrator Resume Examples & Samples
- Intimate knowledge of non-root installation with fully integrated AD/Kerberos authentication
- Working with data delivery teams to setup new Hadoop clusters. This job includes setting up Kerberos principals and testing
- Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Accumulo, Impala, Hue, Spark, Hive, YARN, ZooKeeper and Postgres
- Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise
- Manage, Troubleshoot and review Hadoop log files
- Eyes-on-glass cluster monitoring and responding to internal tickets and email alerts. File system management and monitoring
- Setup Splunk monitoring
- HDFS and other Cloudera Hadoop components support and maintenance
- Collaborating with application teams to install Hadoop updates, patches, version upgrades when required
- Aligning with the engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
- 2-3 years of recent Big Data experience
- Hadoop Administration
- Cloudera Hadoop Administration, preferable version 5.5 or higher, or Hadoop development experience with administration experience
- Experience with monitoring clusters, Splunk, Python, Linux Shell Scripting, RHEL 6, UNIX networking, and troubleshooting
- Cloudera Certified Administrator for Apache Hadoop (CCAH) highly desired
32
Senior / Principal Hadoop Administrator Resume Examples & Samples
- Take the lead in ongoing administration of Hadoop infrastructure
- Work with the data platform team to optimize cluster usage and ensure timely execution of business-critical workloads
- Install Hadoop updates, patches, and version upgrades as required
- Perform routine cluster maintenance, such as provisioning new nodes and performing HDFS backups and restores
- Routine cluster monitoring and troubleshooting
- Configuration and monitoring of job isolation, security, and resource queues
- Develop scripts and tools to automate common Hadoop administration tasks
- Work with the devops and data infrastructure teams to identify areas of the Hadoop infrastructure that can be improved
- Participate in an on-call rotation with 24x7 availability requirements
33
Hadoop Administrator Resume Examples & Samples
- Provide technical advice and guidance to ESEF users in designing, developing, validating, and maintaining online CICS mainframe
- Experience setting up new environments with Endevor
- Provide technical guidance and support for the Endevor code repository
- Define Environment, stages, map and master control files, processor groups, system, sub-system types
- Enable Package Processing and security
- Resolve system and user problems related to CICS for mainframe
- Monitor and report on ESEF CICS performance for the mainframe
- Provide technical assistance and support to designers and developers of CICS applications
- Resolve system and user related problems
- Maintain CICS resources
- Monitor and report on overall ESEF mainframe operating system environment
- Provide technical advice and guidance in the areas of ESEF mainframe performance, DASD/Tape management, and HSM/SMS performance
- Produce daily, weekly, monthly and ad hoc performance reports; perform regular analyses of performance and trend reports; and provide tuning recommendations
- Provide tuning recommendations as required for the ESEF mainframe
- Participate in Disaster Recovery Exercises as requested
- Provide technical guidance and support for the software Release process
- Provide technical assistance and guidance with the installation, testing and implementation of selected vendor software as requested
- Use SAS to analyze data for performance and capacity management
- Develops and configures systems specifications that address business requirements, processes, and that fit within architecture standards
- Involved in planning of system and development deployment as well as responsible for meeting software compliance standards
- Establishes and documents system parameters and formats, ensures hardware and software systems compatibility, and coordinates and/or modifies system parameters in terms of existing and projected computer capacity and capabilities
- Revises existing systems and tests functionality of the system to correct deficiencies and maintain more effective data handling, data integrity, conversion, input/output requirements, and storage
- May document testing and maintenance of system updates, modifications, and configurations
- May act as a liaison with other business functions
- The appropriate offering / competency area)
- 2+ years of professional experience with CA Endevor SCM administration (not a user, expertise with administration)
- 4+ years of Knowledge of z/OS control blocks
- 4 + years of Knowledge of ENDEVOR internals with experience as a systems installer/SMPE
- 4+ years of Experience with high-level reporting language such as SAS or EZTRIEVE
- 4+ years of Experience with JCL, TSO/ISPF, COBOL, ALC, REXX/CLIST, Dialog Manager, IBM utilities
34
Hadoop Administrator Resume Examples & Samples
- Design, Administration, management, and tuning of Hadoop environment
- Collaborate with the infrastructure team to coordinate OS-level patching and to identify and solve hardware related issues
- Cluster & Node Maintenance, Health Checks, Automation of Job Monitoring by creating alerts
- Assist development team in identifying the root cause of slow performing jobs / queries (HDFS)
- Capacity Planning / Forecasting
- Develop strategy to automate management and deployment processes (DevOps)
- Deploying and managing all Hadoop platform components
- Work with development staff to ensure all components are ready for release / deployment
- Collaborate with Project Managers, Developers and business staff to develop products & services
- Participate in managing and maintaining the product on an on-going basis
- Strong UNIX/Linux knowledge including the ability to understand the interaction between applications and the operating system
- Ability to provide recommendations and suggestions related to troubleshooting and performance improvement
- Experience designing and administering a reasonably-sized Hadoop cluster (100+ nodes)
- Experience in running, using and troubleshooting the Apache Big Data stack i.e. Hadoop FS, Hive, HBase, Kafka, Pig, Oozie, Yarn, Sqoop, Flume etc
- Ability to create infrastructure capacity plans based on quantitative and qualitative data points
- Experience with implementing and managing security for a multitenancy environment,
- Familiarity with networking stack from TCP/IP and up
- Good work ethics with extremely high standard of code quality, system reliability, and performance
- Experience processing large amounts of structured and unstructured data with MapReduce
35
Hadoop Administrator Resume Examples & Samples
- At least 2 years’ experience working with Hadoop
- A minimum of 5 years’ experience using Unix systems engineering with strong hands-on experience in Linux
- Practical experience in data warehousing
- Passionate about data and/or statistical analysis
- Ability to quickly learn new technologies and adapting to new environments
- Strong analytical competencies and excellent creative problem-solving skills
- Fluent in English and Dutch and/or French
36
Hadoop Administrator Resume Examples & Samples
- Minimum 1 year of experience in Hadoop Stack (MapReduce Framework, HDFS, HBase/Hive)
- Minimum 1 year of experience in Scripting Language (Linux, SQL, Python). Should be proficient in shell scripting
- Minimum 1 year of experience in Applications / Administrative Support (data integration, ETL, BI operations, Analytics support) engagements on large scale distributed data platforms for e.g. Teradata, DB2, Oracle, etc
- Basic understanding of Hadoop Connectors, Oozie, Flume, Sqoop, Thrift, Avro, Zookeeper
- Demonstrate a keen interest in, and fair understanding of, "big data" technology and the business trends that are driving the adoption of this technology
- Demonstrate analytical and problem solving skills; particularly those that apply to a Big Data environment
- Experience may include (but is not limited to) build and support including design, configuration, installation (upgrade), monitoring and performance tuning of any of the Hadoop distributions
- Development, implementation or deployment experience in the Hadoop ecosystem
- Proficiency with at least one of the following: Java, Python, Perl, Ruby, C or Web-related development
- Development or administration on Web or cloud platforms like Amazon S3, EC2, Redshift, Rackspace, OpenShift, etc
- Development/scripting experience on Configuration management and provisioning tools e.g. Puppet, Chef
- Handle deployment methodologies, code and data movement between Dev., QA and Prod Environments (deployment groups / folder copy/ data-copy etc.)
- Should be able to articulate and discuss the principles of performance tuning on Hadoop
- Develop and produce daily/ weekly operations reports and metrics as required by IT management
- Experience on any of the following will be an added advantage
- Hadoop integration with large scale distributed DBMSs like Teradata, Teradata aster, Vertica, Greenplum, Netezza, DB2, Oracle, etc
- Data Modeling or ability to understand data models
- Knowledge of Business Intelligence and/or Data Integration (ETL) solution delivery techniques, models, processes, methodologies
37
Hadoop Administrator Resume Examples & Samples
- Design, Development, testing and deployment of new system in Hadoop environment
- Hadoop clusters design, installation, configuration and monitoring, troubleshooting, security, backup, re-sizing addition / deletion of nodes, performance monitoring and fine-tuning for application development on local and internal cloud
- Development and test environment setup installation and configuration with Hadoop Core, HDFC, MapReduce, Yarn, HBase, MongoDB, Hive, Pig, ZooKeeper, Oozie, Ambari, Java, etc
- Developing a migration plan for other data sources into the Hadoop system
- Load and transform large sets of structured, semi structured and unstructured data
- Design and integrate backend real-time performance metric system
- Hands-on experience with related, complementary open source software platforms and languages --(e.g. Java, Linux, Apache, Perl/Python/PHP)
- Hands-on experience with Data warehouse, BI, and ETL (Extract-Transform-Load) tools (e.g Informatica, Actuate, Pentaho)
- Experience in autosys or similar job scheduling tools
- Knowledge of NoSQL platforms (e.g. key-value stores, graph databases, RDF triple stores)
- Detailed knowledge of RDBMS data modeling and SQL
- Ability to design solutions independently based on high level architecture
- Ability to implement Hadoop based solutions
- Knowledge of HADOOP Framework and programming in Hive and Pig tools, Design, Best Practices and troubleshooting
- Strong knowledge of Dimension Modeling
- Extensive experience in architecting ETL / OLAP solutions
- Nice to have skills
38
Hadoop Administrator Resume Examples & Samples
- Hadoop admin and will be part of the team that delivers top quality, security compliant Hadoop infrastructure for different business lines
- Will need to be cross-skilled to serve the role of a Cassandra administrator (DataStax)
- Is expected to possess strong technical knowledge and help business lines make wise choices in their data warehouse requirements
- Technical lead within the team who acts as SME and helps other members of the team
- Delete as needed
39
Hadoop Administrator Resume Examples & Samples
- S or higher in Computer Science or other technical field
- 3+ years hands-on Hadoop administration experience in a production environment for large scale Hortonworks deployment
- Extensive experience with YARN resource management and queue management
- Strong expertise in Linux systems and system administrator experience
- Strong expertise with Hadoop monitoring tools such as Nagios, Ganglia, Ambari, views etc.,
- Experience in implementing authentication and authorization for production Hadoop environments
- Strong technical knowledge on Hadoop ecosystem such as YARN, Map Reduce, HDFS, Spark, Hive
- Hands-on experience in Hadoop cluster setup, monitoring and administration
- Proven ability to work with application development team and coordinate with off-shore resources
- Hortonworks admin certification is preferred
40
Senior Hadoop Administrator Resume Examples & Samples
- You will be responsible for maintaining and scaling production Hadoop, HBase, Kafka, and Spark clusters
- You will improve scalability, service reliability, capacity, and performance by adding or removing nodes as necessary
- You will collaborate with development teams to install updates/patches, manage version stability across Hadoop and Spark offerings including Cloudera components such as Kudu as required
- You will be responsible for managing partial and/or complete encryption at rest of data in our clusters
- You will manage security, authorization, access control and data provision to our various subscribing business units
- You will write automation code for managing large Big Data clusters
- You are not an operator, you’re an experienced software engineer focused on operations
- You will work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services
- You will participate in the occasional on-call rotation supporting the infrastructure
- You will roll up the sleeves to troubleshoot incidents, formulate theories and test your hypothesis, and narrow down possibilities to find the root cause
- Hands on experience with managing production clusters (Hadoop, Kafka, Spark, more)
- Strong development/automation skills. Must be very comfortable with reading and writing Python, and at least reading Java code
- 5+ years of Unix/Linux experience, 2+ years of Hadoop experience in production, in medium to large clusters
- Tools-first mindset. You build tools for yourself and others to increase efficiency and to make hard or repetitive tasks easy and quick
- Experience with Configuration Management and automation
- Proactive, organized, focused on building, improving, resolving and delivering. Good communicator in and across teams
41
Hadoop Administrator Resume Examples & Samples
- Manages large scale Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring
- Performs day-to-day support for Red Shield application and monitoring tasks for assigned systems. Works with internal and external customers and vendors to resolve technical system problems in a timely manner with a primary focus on complex problems
- Utilizes proven systems and scripting skills to execute on highly complex tasks related to hardware and software technology component analysis, integration, and incident and problem resolution
- Researches and evaluates new technologies and software products to determine feasibility and desirability of incorporating their capabilities within the company's products. Assists in the formulation and execution of test plans for Proof of Concepts. Researches and recommends innovative, and where possible, automated approaches for system administration tasks. Identifies approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues
- Supports development, QA and product teams by providing high-level analysis and AOD environment based design reviews, performance, scalability and benchmark test guidance, and subject matter expertise in technology and design
- Experience with highly distributed systems, focusing on application support on these systems
- Prior experience optimizing CPU, core, memory and disk utilization of applications that run on Hadoop clusters
- Knowledge of best practices related to security, performance, and disaster recovery
- Strong experience with Hadoop monitoring tools
42
Hadoop Administrator Resume Examples & Samples
- 3-4 years Experience in Hadoop/Bigdata Administration and total 10+ years of IT experience
- Proficiency in Linux shell, sed and awk scripting
- Install, configure and support the Bigdata ecosystem components
43
Big Data-hadoop Administrator Resume Examples & Samples
- Hadoop Cluster administration and operations
- Experience in administration of HDFS, YARN, MapReduce, Hive, HBase, Zookeeper, Sqoop, Pig, Kafka, Spark, Strom, Ranger, Knox, Hue, Ambari, Falcon, HA and Security
- Basic Java and strong Linux administration skills
- Knowledge on Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Hive, HBase, Zookeeper, Sqoop, Pig, Kafka, Spark, Ranger, Knox, Hue, Ambari, Falcon, HA and Security)
- Implementation and ongoing administration of Hadoop infrastructure
- Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing Hadoop Services access for the new users
- Cluster maintenance as well as creation and removal of nodes using tools like Ambari
- Performance tuning of Hadoop clusters and Hadoop Applications
- OS level support and maintenance
- Ability to communicate comfortably with all levels of management and actively participate on leadership teams
- Improving and developing the knowledge & skills of others
- Ability to work closely with and develop relationships with clients
- Highly organized with a positive 'can do' attitude
- Knowledge of progress monitoring and reporting
- Able to handle communications
44
Hadoop Administrator Resume Examples & Samples
- Responsible for administration of the Hadoop platforms
- Developing reporting metrics on the platform
- Hadoop administration
- Strong business analytical skills a must; ability to apply business logic to design and implement data mining techniques on large data sets
- Maintain databases and related programs in a thorough and efficient manner
- Experience with Java MapReduce
- Experience with BI reporting and data visualization tools
- 2+ years' experience of Big Data Business Intelligence stack
- Hadoop development tools
- Proficiency in the use of Teradata SQL
- Python and R-Studio development
- Working knowledge of 'Big-Data' concepts and Hadoop/Hive, Teradata Aster, and Teradata database tools
- Working knowledge of application development and/or web development a plus
- Experience normalizing data to ensure it is homogeneous and consistently formatted to enable sorting, query and analysis
- Understands how to balance cost and benefit
45
Hadoop Administrator Resume Examples & Samples
- As a HADOOP Administrator you will Support, Administer, Manage, and Tune the sub-Terra byte Data Systems that will enable S&P Global Market Intelligence to ingest, manage, process and serve-up Market Data Products (Global Risk Solutions, Pricing, Ratings & Financial Aggregates) as well as our highly transactional and dynamic web based CIQ Platform & Credit Solutions Portal
- Manage large-scale Hadoop cluster environments, handling all Hadoop environment builds, including design, cluster setup, performance tuning, ongoing monitoring and capacity planning
- Collaborate with the global team in ensuring reliability and supportability of the HDFS Clusters and other Open Source Software like SOLR/Cassandra
- Manage key database releases for QA, Alpha, Production and DR as part of the overall SDLC
- Maintain the Software by patch applications and enhancements/upgrades of environments
- Automate routine maintenance tasks using standard scripting practices
- Work with other teams with in operations and peer groups like Development and QA
- Work with IT Service Management and other groups and make sure that all events, incidents and problems are resolved as per the SLA
- Contribute to best of breed product support tools including run books, monitoring, and knowledge bases to aid in the product support process
- Suggest improvements to current processes and tools we use and also suggest implementation ideas
- Good hands on experience in Linux Environments
- Extensive Experience with HDFS (Hortonworks is preferred) and its assocaited technologies like Spark, HIVE, Yarn, Kafka is a must
- Experience with additional open Source Software like SOLR, Cassandra, Vertica and PostgreSQL is a huge Plus
- Good experience with Operations Support, administration, performance tuning, and database monitoring
- Good knowledge on Shell Programming, Python, Perl Scripting, JSON or any other scripting or program language is a must
- Excellent communication skills, with strong verbal and writing proficiencies
- Ability to troubleshoot problems involving Client Libraries (like JDBC), Web Logic, Operating Systems, Network and Storage is a plus
- Bachelor's degree in Computer Science, Information Systems or Engineering
- 3+ years of hands-on database administration, support and performance tuning experience
- Experience in a start-up or Agile or Dev Ops environment is a plus
- ITIL V3 Foundation Certified is a plus
46
Hadoop Administrator Resume Examples & Samples
- Recommend security management best practices including the ongoing promotion of awareness on current threats, auditing of server logs and other security management processes, as well as following established security standards
- Designs and implements a toolset that simplifies provisioning and support of a large cluster environment
- Plans and executes major platform software and operating system upgrades and maintenance across physical and virtualized environments
- Works with project teams to integrate EDH access points
- Strong focus on designs, builds, deployments, security, system hardening and securing services
- Creates and maintains detailed up-to-date technical documentation
- Proactively manages EDH system resources to assure maximum system performance and appropriate additional capacity for peak periods and growth
- Reviews performance stats and query execution/explain plans, and recommends changes for tuning Hive/Impala queries
- Partners with Infrastructure to identify server hardware, software and configurations necessary for optimally running big data workloads (i.e. Spark, Hive, Impala, etc.)
- Provides support to the user community using incident and problem management tools, email, and voicemail
- Periodic off-hours work required including weekends and holidays. Must be able to provide 24 by 7 on-call support as necessary
- Maintains current knowledge of industry trends and standards in a “Big Data” space/ecosystem
- Minimum 4 years of experience supporting products running on AIX, Linux or other UNIX variants
- Minimum 2 years of shell scripting experience
- Minimum 5 years of experience supporting production JVMs
- Understanding of Hadoop and distributed computing
- Understanding of Hadoop components (i.e. HDFS, YARN, Zookeeper, Sqoop, Hive, Impala, Hue, Sentry, Spark, Kafka, flume, etc.)
- Understanding of message based architecture
- Version control experience (Unix, git, git preferred)
- Demonstrated ability in Systems Management and Administration (applying fixes, loading the OS, creating Gold images, resolving system issues, working with vendors to resolve issues, etc.)
- Proficient with operating system utilities as well as server monitoring and diagnostic tools to troubleshoot server software and network issues
- Knowledge of Relational Databases (DB2, Oracle, SQL Server, DB2 for iSeries, MySQL, Postgres, MariaDB)
- Deep knowledge of associated industry protocol standards such as: LDAP, DNS, TCP/IP, etc
- Understanding of Enterprise level services - Active Directory, PKI Infrastructure (Venafi)
- Understanding of Kerberos, SAML, cross-realm authentication and Kerberized services
- Security experience including SSL certificates,TLS, hardening, PEN tests, etc
- Experience with VMWare (vSphere), virtualized environments and/or Microsoft Azure
- Configuration Management experience (puppet preferred)
- Experience in System/Database Backup and Recovery
- Experience with Tivoli Storage Management and/or Commvault
- B.S. degree in Computer Science or equivalent formal training and experience
47
Hadoop Administrator Resume Examples & Samples
- Bachelor's Degree or equivalent is required
- 3 plus years of IT experience which includes supporting Java applications on Linux systems is required
- Extensive experience in Hadoop echo system including Spark, MapReduce, HDFS, Hive, HBase is required
- Experience in troubleshooting problems and working with other teams to determine the root cause is desired
- 3 plus years of experience with Linux/Unix systems and scripting knowledge is required
- Job requires to be part of 24x7 on-call rotation and production support
48
Senior Hadoop Administrator Resume Examples & Samples
- A minimum of 5 years of IT experience including a minimum of 3 years supporting multi-tier applications on Linux systems is required
- A minimum 3 years of experience in Hadoop echo system including MapReduce, HDFS, Hive, HBase, NO-SQL is required
- A minimum of 3 years of experience with Linux/Unix systems and scripting knowledge is required
- Demonstrated experience in troubleshooting problems and working with other teams to determine the root cause is desired
- Hands on experience with automation tools such as Puppet is a plus
- Job requires to be part of 24x7 on-call rotation and production support is required
49
Hadoop Administrator Resume Examples & Samples
- Minimum experience 2-5 years as a DBA
- Set-up multiple databases supported by a single code engine
- Large systems experience with millions of records
- Experience in working in a multi staged configured environment (unit test, Systems test, user Acceptance test)
- Experience working in a failover environment or high availability environment (99.9 or higher) highly desirable
- Experience with SAS products or Environments highly desirable
- Experience with IBM DataStage ETL tool highly desirable
50
Senior Hadoop Administrator Resume Examples & Samples
- Develop and maintain operational best practices for smooth operation of HBase/Hadoop clusters
- Install, manage, upgrade and backup Hadoop, HBase and related third party applications on systems
- Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments Enhance monitoring and alerting for cluster reliability focusing on preventive measures
- Work with peers in development to tune infrastructure and plan for resource management including adding / removing cluster nodes for maintenance or capacity needs
- Participate in on-call support rotation
- Participate and present in HBase/Hadoop community and industry events
- Work with Architecture and Development teams to test and benchmark new versions, patches and software components for functionality and reliability
- Review existing software/hardware architecture and identify areas for improvement in the areas of scalability, maintainability, and performance
- Cluster maintenance as well as creation and removal of nodes using tools like Ganglia,Nagios,Cloudera Manager Enterprise, Dell Open Manage and other tools
- Monitor Hadoop cluster connectivity and security
- Manage and review Hadoop log files
- Design, implement and maintain security with the OCLC security teams
- HDFS support and maintenance
- Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
- Data modelling, design & implementation based on recognized standards
- Database backup and recovery
- Database connectivity and security
- Disk space management
- Software patches and upgrades
- Automate manual tasks
- 3+ years supporting open source Linux operating systems (CENTOS, SuSE, RedHat) and hardware in an enterprise environment
- Experience managing and supporting open source environments including active participation in the community
- Ability to read, understand, and build java code
- Knowledge of Hadoop architecture, administration and support; Experience with Cloudera Hadoop preferred
- Expertise in typical system administration duties such as capacity management, performance tuning, system dump analysis, and server hardening (security)
- Strong knowledge of scripting with shell scripting (PHP, PERL, Python)
- Strong understanding of computer architecture, storage and IO subsystems, network and distributed systems
- Experience with versioning, change control and problem management
- High availability experience within and across data centers
- A bachelor's degree or higher in computer science
- The most essential requirements are: ability to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups
- Experience with RDBMS technologies and SQL language; MySQL highly preferred
- Hands on experience with the Hadoop stack (MapReduce, Sqoop, Pig, Hive, Flume)
- Hands on experience with opens source monitoring tools including Nagios and Ganglia
- Good knowledge of Linux as Hadoop runs on Linux
- Knowledge of Troubleshooting Core Java Applications is a plus
51
Hadoop Administrator Resume Examples & Samples
- Minimum 8+ Years of experience is required
- General operational expertise - good Linux troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Hadoop skills like HBase, Hive, Sqoop, Impala, Spark, Kafka, Parquet etc
- Should be able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups
- Familiarity with open source configuration management and deployment tools and Linux scripting
- Desirable : Knowledge of Troubleshooting Core Java Applications
52
Hadoop Administrator Resume Examples & Samples
- Administer Hadoop cluster providing support for all administrative tasks such as user management, security planning and implementation, backups, disk management and cluster maintenance (e.g. re-indexing or node balancing)
- Hadoop Cluster capacity planning and expansion
- Install and configure Hadoop ecosystem components
- Develop and maintain documents pertaining to installation and configuration (to ease future cluster installations/deployments and support)
- Liaison with Software Vendors for any technical support
- Install software patches and upgrades
- Configure Ranger security policies as requested
- Assess current technical architecture
- Manage and troubleshoot scheduled Hadoop jobs
- Performance monitoring and tuning of the ecosystem tools
- 7+ years’ experience in IT and business intelligence
- Minimum 5+ years overall experience
- Strong knowledge in data warehousing concepts
- Understand Logical and Physical data modeling best practices and techniques
- Experience in developing slowly changing dimensions, error handling and performance tuning
53
Hadoop Administrator Resume Examples & Samples
- Hadoop cluster setup and administration (either CDH or HDP)
- Ambari administration
- Ranger and Knox
- Cluster security
- Java and Middleware
- Trouble shooting cluster infrastructure issues
- Understanding of Change Management
- Strong oral and written communication skills"-
- NoSQL technologies
- Shell scripting and using KShell, Bourne Shell, Power Shell
- Experience in banking domain
54
Hadoop Administrator Resume Examples & Samples
- 4+ years of administration experience on Big Data Hadoop Ecosystem
- In-depth knowledge of capacity planning, performance management and troubleshooting for of various Hadoop components
- In-depth understanding of Hadoop storage frameworks (HDFS, Hbase etc) and compute frameworks (Spark, MapReduce etc)
- Familiarity and experience using tools such as, Sqoop, Hive, Impala, etc
- Must have experience with monitoring tools used in the Hadoop ecosystem such as Cloudera Manager, Nagios etc
- Strong administrator experience on a Big Data Hadoop Ecosystem and components (Sqoop, Hive, Pig, Flume, etc
- Understanding of various aspects of Hadoop security such as Kerberos, Sentry, LDAP integration tools (SSSD, Centrify, QAS etc), Encryption – TLS/SSL
- In depth knowledge of capacity planning and management for HDFS, YARN/MapReduce, and HBase
- Understands the workings of Apache Sentry, SSSD, or Centrify or Quest QA and AD linkages to HDFS
- Experience with at least one of the following programming languages: Java, Scala, C++
- Extensive Experience with at least one of the following scripting languages: Python, Bash, Perl
- Familiarity with RDBMS platforms (MySQL, Oracle etc) and SQL is preferred
- Familiarity with version control, job scheduling and configuration management tools such as JIRA, Ansible, Github, Jenkins, etc
- Strong understanding and experience with Linux internals and administration (Red Hat)
- Experience administering Atlassian products (Jira)
- Strong understanding of Linux File system management, Networking and resource management
- Experience with Linux security integration solutions such as SSSD, Centrify etc
- Experience with software package management (yum, apt-get, rpm etc)
- Experience with RHEL is preferred
- Install and maintain platform level Hadoop infrastructure including Hadoop additional tools
- Troubleshooting on Hadoop technologies including HDFS, MapReduce, YARN, Hive, Pig, Flume, HBase, Sqoop, Zookeeper, Spark, Kafka, etc
55
Hadoop Administrator Resume Examples & Samples
- Production Hadoop Platform Administration. (Apache Foundation, Cloudera, MapR, Hortonworks, IBM Big Insights)
- Knowledge of Perl, Python or other scripting languages
- Hadoop Monitoring tools (Nagios, Ganglia, CDH CM, Ambari)
- Hadoop production installation experience
- Securing Hadoop clusters
- Performance and capacity management
- Web & Cloud platforms (Amazon S3, EC2, Redshift, Rackspace, OpenShift)
- Web/App Server & SOA administration (Tomcat, JBoss, etc.)
- Certified Hadoop Administrator
56
Principal Hadoop Administrator Resume Examples & Samples
- Working with engineering, data scientist, and Customer teams to scope, size, install and configure components of the open source Big Data platform
- Serving as an escalation point for the Intellicloud Hadoop Managed Services team that provide on-going operational support for Intellicloud customers
- Working with the Intellicloud Devops team to develop and ensure consistent deployment of best practices across all of Intellicloud Hadoop projects
- Working with Intellicloud Hadoop recruiting to hire additional Hadoop Administrators to facilitate team expansion, here and abroad
- Designing and developing tools to support proactive administration and monitoring of the open source Big Data platform
- Knowledge of ITIL processes
- Hadoop security methodologies (Cloudera, Hortonworks or MapR)
- Hadoop Performance and capacity management
57
Hadoop Administrator Resume Examples & Samples
- Extensive Experience with HDFS (Hortonworks is preferred) and its associated technologies like Spark, HIVE, Yarn, Kafka is required
- Experience with additional open Source tools like SOLR, Cassandra, Vertica and PostgreSQL is a huge advantage
- Good experience with Operations, administration, performance tuning, and database monitoring
- Good knowledge on Shell Programming, Python, Perl Scripting, JSON or any other scripting or program language is a requirement
- Superb communication skills, with strong verbal and writing proficiencies
- Ability to solve problems involving Client Libraries (like JDBC), Web Logic, Operating Systems, Network and Storage is preferred
- ITIL V3 Foundation Certified - preferred
58
Hadoop Administrator Resume Examples & Samples
- Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements
- Work closely with our QA Team to ensure data integrity and overall system quality
- Provide oversight and guidance to our HDFS team --Design and develop HDFS based solutions in Hive, Pig --Programming using Hive QL to generate reports
59
Hadoop Administrator Resume Examples & Samples
- Experience with Hadoop architecture, administration and database management
- Experience maintaining Hadoop clusters
- Operational experience with Hadoop technologies include Ambari, Ranger, Atlas, Knox, NiFi, Kafka, Storm, Hive, Pig, MapReduce, HDFS, HBase, Accumulo, Spark
- Experience with relational databases (preferably Microsft SQL Server) and data warehouse concepts
- Experience with IBM MDM Infosphere/Datastage in a Hadoop environment
60
Hadoop Administrator Resume Examples & Samples
- Supporting the day-to-day operations of the Hadoop Cluster
- Mentoring new Hadoop Administrators
- Candidate should assist troubleshooting issues
- Strong communication and collaboration skills
- Strong Linux skills (including Bash shell scripting)
- Expert level hands-on experience managing a Hadoop cluster (Horton works/ Cloudera, MapR)
- Strong understanding of Hadoop security concepts and implementations (Kerberos and Ranger/Sentry…)
- Experience in Platform up gradation (Horton works/Cloudera/MapR ...), Backup and recovery process
- Expert level hands-on experience managing a Hadoop cluster (Horton works preferred but not required)
- Strong understanding of Hadoop security concepts and implementations (Kerberos and Ranger)
- Strong Linux skills (including Bash shell scripting) and java skill is must
- Strong understanding of Hadoop in the Cloud (AWS and Azure)
- Good to have certified in Administration
- NiFi, Kafka, Hue Configuration and administration experience
61
Hadoop Administrator Resume Examples & Samples
- Monitor the overall performance of the Cloudera data lake
- Performance tuning of Cloudera clusters and MapReduce routines
- Cloudera Cluster maintenance including the addition and removal of nodes
- Monitor and address user productivity and cluster performance
- Optimize clusters for future workloads
- Ongoing troubleshooting, diagnosing, tuning, HDFS management, Cloudera Director and solving Hadoop issues
- Create BASH/Python scripts to assist with trouble shooting, administration and software deployments
- Track and protect access to sensitive data including a focus on being prepared for an audit, tracking who is accessing what data and what are they doing with it
- Monitor Central IT Cloudera connectivity and security as prescribed by the Security Admin and the Solutions Architect
- Communicates with Cloudera vendor on technical issues
- Works tightly with DevOps / Data Integration Admin on cluster related deployments
- Manages YARN, MapReduce, Spark, and HDFS
- Utilizes Cloudera Manager to assist in cluster management including aggregated logging, configuration management, resource management, reports, alerts, and service management
- Collaborate with National IT infrastructure team on hardware replacements, upgrades and maintenance of the DSF
- Refines cluster configuration changes and deployment to integrate with the DSF
- Configures the FairScheduler to provide service-level agreements for multiple users of a cluster
- Documents DSF best practices for preparing and maintaining Cloudera Cluster in production
62
Hadoop Administrator Resume Examples & Samples
- Administration and migrations of Hadoop environment
- Working across business teams to ensure alignment between business objectives and technical architecture
- Working on unusually complex problems and provide solutions which are highly innovative and ingenious
- Providing technical direction and system architecture advice for individual initiatives
63
Hadoop Administrator Resume Examples & Samples
- Interface with users to define and document software design requirements
- Develop and validate the software design
- Develop and unit test the software and the software packaging
- Develop specifications to build work products from the configuration management system
- Build development and production releases
- Make appropriate fixes to existing code where required to improve quality and performance
- Demonstrate a high degree of software development skills
- Demonstrate a high degree of software development tool expertise
- Support the Application, ETL, Teradata, Aster, and Hadoop platform design and integration efforts
- Participate in performance, integration, and system testing of the application
- Establish and maintain a configuration management and change management system for controlling work products
- Identify the configuration of selected work products to be under configuration management and that compose the baselines at given points in time
- Maintain control over the configuration of the work product baseline
- In depth knowledge of programming languages such as Java, C++, Perl, etc
- In depth knowledge of the software development tools
- In depth knowledge of the development processes and methodology
- Proficiency with configuration management tools
- Expert in software configuration process and controls
- Support of testing functions
- Knowledge of operating systems and environments
- Knowledge of Architecture Principles, Advocated Positions, Design Patterns, and Implementation Alternatives
- Understanding of the Teradata Reference Information Architecture
64
Senior Hadoop Administrator Resume Examples & Samples
- Architecture of our Hadoop infrastructure to meet changing requirements for scaling, reliability, performance, manageability
- Work with core production support personnel in IT and Engineering to automate deployment and operation of the infrastructure; manage, deploy, and configure infrastructure with Ansible or other automation toolsets
- Responsible for monitoring the Linux community and report on important changes/enhancements to the team
- Ability to work well with a global team of highly motivated and skilled personnel - interaction and dialog are requisites in this dynamic environment
- Research and recommend innovative, and where possible, automated approaches for system administration tasks; identify approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues
- 5+ years of professional experience working with Hadoop (HDFS & MapReduce) and related technology stack
- A deep understanding of Hadoop design principals, cluster connectivity, security, and the factors that affect distributed system performance
- MapReduce experience a plus
- Solid understanding of automation tools (Puppet, Chef, Ansible)
- Expertise with at least one, if not most of the following languages: Python, Perl, Ruby, or Bash
- Prior experience with remote monitoring and event handling using Nagios, ELK
- Solid ability to create automation with Chef, Puppet, Ansible, or Shell
- Good collaboration & communication skills, with the ability to participate in an interdisciplinary team
- Strong written communications and documentation skills
- Knowledge of 'best practices' related to security, performance, and disaster recovery
65
Hadoop Administrator Resume Examples & Samples
- Participate in an Agile Scrum team process, collaborating closely with developers, architects, test engineers, and fellow operations engineers
- Create and maintain Hadoop clusters and support various component/supporting services (Ambari. Spark, HBase, etc.)
- Document and automate Hadoop administration and related system administration tasks, training fellow operations engineers when needed
- Support fellow operations engineers in maintaining and enhancing application CI/CD pipeline and environments
- Mentor other operations engineers in Hadoop administration best practices, participate in peer reviews of operations automation code and technical design meetings
- Troubleshoot and support application problems
- BS in Computer Science (or related field) and 2-5 years of experience in Hadoop administration or Linux system administration combined with experience administering distributed applications
- Experience in contemporary infrastructure-as-code practices using tools such as Puppet, Chef, or Ansible and Vagrant, Terraform, CloudFormation, or Azure Resource Manager Templates
- Hands on experience working with HDFS, Oozie, Sqoop, Hive, and Spark
- Excellent knowledge in troubleshooting Hadoop cluster issues
- Strong Linux system administration experience and some Windows system administration experience (user/group management, storage management, patching and hardening)
- Experience administering production Hadoop clusters on a variety of virtualization platforms, whether atop IaaS offerings or leveraging CSP PaaS offerings
- Experience administering RDBMS platforms such as Oracle, MySQL, and PostgreSQL. Working knowledge of NoSQL platforms such as Cassandra/MongoDB or In memory data platforms such as HANA
- Experience with network engineering, firewall configuration, monitoring tools (Nagios, Icinga, Prometheus), log aggregation tools (ELK, GrayLog)
- Experience with: Hashicorp Consul, Vault, Vagrant, and Terraform; Puppet; Docker and Docker Swarm; Jenkins
- Experience with distributed source control systems, preferably Git or Stash
66
Hadoop Administrator Resume Examples & Samples
- Responsible for design, implementing, and support of Hadoop infrastructure to delivery of data from operational systems and files into ODSs (operational data stores), downstream Data Marts and files
- Experience with the Hadoop/Spark ecosystem, including HDFS, Hive, Impala, MapReduce, Sqoop, YARN, Sentry including high level of troubleshooting skills
- Working knowledge of Hadoop security systems such as Kerberos
- Code deployment and configuring HDP data replication
- Expertise in Cluster management and backup, Cluster Security, Performance Troubleshooting, and Tuning
- Has experience in AD integration
- Has good Core Java Programming experience
- Works with Project Managers, developers, end users and architects to define and process requirements plus work in collaboration with the rest of the team for effective solutions
- Deliver projects on-time and to specification with quality
- 8 years’ experience in managing data lineage and performing impact analyses
- Experience working in Hive or related tools on Hadoop, Performance tuning, File Format, data migration conversion
- Knowledge of HPE Apollo hardware knowledge
- Knowledge of NIFI and Ambari
- Self-starter with the ability to work independently and take initiative
- Excellent written and oral communication skills, with the ability to articulate and document processes and workflows for use by various individuals of varying technical abilities
67
Hadoop Administrator, Senior Principal Resume Examples & Samples
- Responsible for design of Hadoop solutions
- Strong business analytical skills a must; ability to apply business logic to design and implement data mining techniques
- Teradata UDA platform administration
- Viewpoint report development
- Aster development and administration
- Experience designing, developing, implementing and maintaining a database and programs to manage data analysis
