JOB DESCRIPTION

Skill: Cloud Data Solution Architect

Role: T0

Our Big Data Competency Center offers consulting services for big data development, tool evaluations, solution architecture and design, and end-to-end implementation services using big data ecosystems like Hadoop, NOSQL, graph databases, and appliances. Our state-of-the-art Advanced Technology Centers in the United States and India have the infrastructure to conduct R&D as well as PoCs across multiple technologies. We help measure enterprise analytics maturity, deliver an analytics roadmap, and recommend embedding analytics into existing operations to measure business outcomes. Our Advanced Analytics Competency Center offers comprehensives services in business analytics that provide decision support, trending, and forecasting.

The service offering range spans from traditional BI use cases to more complex and advanced analytical solutions like Social Analytics, Web Data Analytics, Text Analytics, Real-time BI, and Predictive Analytics (Predictive Analytics Models such as Targeting Customers by Direct Marketing, Market Basket Analysis, Case Management), Model Implementation, Advanced Data Visualization, End User Application, etc.

Key responsibility:

• Setup, administration, monitoring, tuning, optimizing, governing Large Scale Hadoop Cluster and Hadoop components: On-Premise/Cloud to meet high availability/uptime requirements.
• Design implement new components and various emerging technologies in Hadoop Echo System, and successful execution of various Proof-Of-Technology (PoT) / Proof-Of-Concepts (PoC).
• Collaborate with various cross functionalteams: infrastructure, network, database, application for various activities: deployment new hardware/software, environment, capacity uplift etc
• Cloud native stack knowledge( Snowflake, Redshift) experience.
• Data migration experience (AWS , Snowflake) .
• Work with various teams to setupnew Hadoop users, security and platform governance;
• Create andexecutive capacity planning strategy process for the Hadoop platform.
• Work on cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Ambari etc.
• Performance tuning of Hadoop clusters and various Hadoop components and routines.
• Monitor job performances, file system/disk-space management, cluster database connectivity, log files, management of backup/security and troubleshooting various user issues.
• Harden the cluster to support use cases and self-service in 24x7 model and apply advanced troubleshooting techniques to on critical, highly complex customer problems.
• Contribute to the evolving Hadoop architecture of our services to meet changing requirements for scaling, reliability, performance, manageability, and price.
• Setup monitoring and alerts for the Hadoop cluster, creation of dashboards, alerts, and weekly status report for uptime, usage, issue, etc.
• Design, implement, test and document performance benchmarking strategy for platform as well for each use cases.
• Act as a liaison between the Hadoop cluster administrators and the Hadoop application development team to identify and resolve issues impacting application availability, scalability, performance, and data throughput.
• Research Hadoop user issues in a timely manner and follow up directly with the customer with recommendations and action plans.
• Work with project team members to help propagate knowledge and efficient use of Hadoop tool suite and participate in technical communications within the team to share best practices and learn about new technologies and other ecosystem applications.
• Automate deployment and management of Hadoop services including implementing monitoring.

Drive customer communication during critical events and participate/lead various operational improvement initiatives