Attention prospective job seekers! Beware of fraudulent offers Read more
Skill: Pyspark QA
Role / Tier: T2/Senior Consultant
Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark.
Hands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from different databases.
Good knowledge at using Spark APIs to cleanse,explore,aggregate,transform, store analyse available data and potential solutions,
eliminate possible solutions and select an optimal solution.
Experience in distributed processing, storage frameworks,RDD,Dataframe with operation like diff Action Transformation
Experience in UDF,Lambda,pandas,numpy.
Experience in installing,configuring, debugging and troubleshooting Hadoop clusters is desired skill.
knowledge of deploying and managing ETL pipelines,RDBMS technologies PostgreSQL,MySQL,Oracle,etc.
knowledge with modern DevOps toolchains.
knowledge of dataframes,Pandas,data visualization tools,data mining.
knowledge of statistical ,machine learning models and business intelligence.
knowledge of JIRA,Bitbucket GitHub and scheduling tools like Automic Airflow.
knowledge of cloud-based infrastructure, AWS services EC2,EMR,S3,Lambda,EBS, IAM,Redshift,RDS etc.
We only accept the following file extensions: .pdf, .docx or .doc
Maximum file size: 1 MB
File name must not include special characters or spaces (e.g. “name_resume.pdf”)
Keep me up to date via email and SMS Text regarding Virtusa career opportunities and company news
I have read and agree to the content in the privacy statement
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 36,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
Your browser does not support iframes.
Check your downloads folder for files and implementation instructions.
Assets are now available in your profile for future editing and use.