Attention prospective job seekers! Beware of fraudulent offers Read more

Cloud Data Lead Software Engineer

Colombo, Western Province, Sri Lanka
Apply
Cloud Data Lead Software Engineer - CREQ186510
Description

Qualifications:

  • Proven 8+years of experience in Big Data technologies, including Kafka, Elasticsearch, Logstash, and Kibana.
  • Strong expertise in Data Engineering and ETL/EDW Design Process and Practices.
  • Proficiency in Data Modeling and understanding of effective data structures.
  • Experience with Change Data Capture (CDC) processes, with knowledge in Debezium or similar tools being advantageous.
  • Expertise in On-premises to Cloud Data Migration.
  • Experience with Hortonworks Data Platform or Cloudera Distribution stacks.
  • Hands-on experience with AWS services such as RDS, DynamoDB, Data Pipeline, Database Migration, and AWS Kafka.
  • Proficiency in GIT/Bit Bucket/SVN configuration for version control and CI/CD practices.
  • Strong understanding of Source to Target mapping and Data Modeling practices.
  • Experience with Rest API processes for data integration.
  • Proficiency in Agile Methodology using SCRUM or Kanban.
  • Experience in the Insurance domain is desirable.
  • Strong client handling skills.
  • Additional Advantage if experienced in Python and Spark.
  • Hands-on SQL experience for coding, optimization, and fine-tuning.

    Responsibilities:

    • Lead and oversee cloud data projects, with a focus on Big Data technologies such as Kafka, Elasticsearch, Logstash, and Kibana.
    • Drive Data Engineering and ETL/EDW Design Process and Practices to ensure efficient and scalable data solutions.
    • Utilize expertise in Data Modeling to design and implement effective data structures.
    • Implement Change Data Capture (CDC) processes, with added advantage if knowledgeable in Debezium or any CDC tools.
    • Lead On-premises to Cloud Data Migration initiatives, ensuring seamless transition and optimization.
    • Utilize Hortonworks Data Platform or Cloudera Distribution stacks for efficient data processing.
    • Leverage AWS services including RDS with PostgreSQL, DynamoDB, Data Pipeline, Database Migration, and AWS Kafka for cloud development.
    • Configure and manage code repositories using GIT/Bit Bucket/SVN for effective version control and implement CI/CD practices.
    • Perform Source to Target mapping and Data Modeling practices to ensure data integrity and consistency.
    • Implement Rest API processes for data integration (PUT/GET) as required.
    • Work in Agile Methodology using SCRUM or Kanban for efficient project delivery.
    • Experience in the Insurance domain is a plus.
    • Handle Client interactions and requirements effectively, ensuring customer satisfaction.
    • Additional Advantage if experienced in Python and Spark for data processing and analysis.
    • Utilize hands-on SQL experience for coding, optimization, and fine-tuning of database operations.
Primary Location
Colombo, Western Province, Sri Lanka
Job Type
Experienced
Primary Skills
Solution Design, Data Modelling
Years of Experience
5
Qualification

Qualifications:

  • Proven 8+years of experience in Big Data technologies, including Kafka, Elasticsearch, Logstash, and Kibana.
  • Strong expertise in Data Engineering and ETL/EDW Design Process and Practices.
  • Proficiency in Data Modeling and understanding of effective data structures.
  • Experience with Change Data Capture (CDC) processes, with knowledge in Debezium or similar tools being advantageous.
  • Expertise in On-premises to Cloud Data Migration.
  • Experience with Hortonworks Data Platform or Cloudera Distribution stacks.
  • Hands-on experience with AWS services such as RDS, DynamoDB, Data Pipeline, Database Migration, and AWS Kafka.
  • Proficiency in GIT/Bit Bucket/SVN configuration for version control and CI/CD practices.
  • Strong understanding of Source to Target mapping and Data Modeling practices.
  • Experience with Rest API processes for data integration.
  • Proficiency in Agile Methodology using SCRUM or Kanban.
  • Experience in the Insurance domain is desirable.
  • Strong client handling skills.
  • Additional Advantage if experienced in Python and Spark.
  • Hands-on SQL experience for coding, optimization, and fine-tuning.

    Responsibilities:

    • Lead and oversee cloud data projects, with a focus on Big Data technologies such as Kafka, Elasticsearch, Logstash, and Kibana.
    • Drive Data Engineering and ETL/EDW Design Process and Practices to ensure efficient and scalable data solutions.
    • Utilize expertise in Data Modeling to design and implement effective data structures.
    • Implement Change Data Capture (CDC) processes, with added advantage if knowledgeable in Debezium or any CDC tools.
    • Lead On-premises to Cloud Data Migration initiatives, ensuring seamless transition and optimization.
    • Utilize Hortonworks Data Platform or Cloudera Distribution stacks for efficient data processing.
    • Leverage AWS services including RDS with PostgreSQL, DynamoDB, Data Pipeline, Database Migration, and AWS Kafka for cloud development.
    • Configure and manage code repositories using GIT/Bit Bucket/SVN for effective version control and implement CI/CD practices.
    • Perform Source to Target mapping and Data Modeling practices to ensure data integrity and consistency.
    • Implement Rest API processes for data integration (PUT/GET) as required.
    • Work in Agile Methodology using SCRUM or Kanban for efficient project delivery.
    • Experience in the Insurance domain is a plus.
    • Handle Client interactions and requirements effectively, ensuring customer satisfaction.
    • Additional Advantage if experienced in Python and Spark for data processing and analysis.
    • Utilize hands-on SQL experience for coding, optimization, and fine-tuning of database operations.
Travel
No
Job Posting
01/06/2024

Join Virtusa

 

Please enter a valid email address to begin your application.

Thank you for verifying your email. Please proceed with the steps below to apply.

We only accept the following file extensions: .pdf, .docx or .doc
Maximum file size: 1 MB
File name must not include special characters or spaces (e.g. “name_resume.pdf”)

Please attach your CV/Resume, ensure it is in the correct format and smaller than 1MB.
We only accept the following file extensions:

Thank you. You already have an active account with Virtusa's hiring system. Please login to our portal to proceed with your application or apply for more opportunities.

LoginClick to Login

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

Learn more