Attention prospective job seekers! Beware of fraudulent offers Read more

Pyspark QA

Bangalore, Karnataka, India
Apply
Back to Results Click to Back to Results
Pyspark QA - CREQ167964
Description

Skill: Pyspark QA

Role / Tier: T2/Senior Consultant

Required Skills:

Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark.

Hands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from different databases.

Good knowledge at using Spark APIs to cleanse,explore,aggregate,transform, store analyse available data and potential solutions,

eliminate possible solutions and select an optimal solution.

Experience in distributed processing, storage frameworks,RDD,Dataframe with operation like diff Action Transformation

Experience in UDF,Lambda,pandas,numpy.

Experience in installing,configuring, debugging and troubleshooting Hadoop clusters is desired skill.

Preferred skills

knowledge of deploying and managing ETL pipelines,RDBMS technologies PostgreSQL,MySQL,Oracle,etc.

knowledge with modern DevOps toolchains.

knowledge of dataframes,Pandas,data visualization tools,data mining.

knowledge of statistical ,machine learning models and business intelligence.

knowledge of JIRA,Bitbucket GitHub and scheduling tools like Automic Airflow.

knowledge of cloud-based infrastructure, AWS services EC2,EMR,S3,Lambda,EBS, IAM,Redshift,RDS etc.

Primary Location
Bangalore, Karnataka, India
Job Type
Experienced
Skill
Data-Data Warehouse Testing with Data Migration testing, ETL testing, Performance testing and Data Security Testing.
Travel
No
Job Posting
27/09/2023
Job Search Form

Join Virtusa

 

We only accept the following file extensions: .pdf, .docx or .doc
Maximum file size: 1 MB
File name must not include special characters or spaces (e.g. “name_resume.pdf”)

Please attach your CV/Resume, ensure it is in the correct format and smaller than 1MB.
We only accept the following file extensions:

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 36,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

Learn more

Back to Results Click to Back to Results
Related jobs