Virtusa Recognized as Global Leader in Gen AI Services by ISG Provider Lens® - Read report
Lead Data Engineer - Azure
Job description
* Contribute using our standard tech stack, which is Python, Linux (via WSL), PostgreSQL, SQL Server, Databricks, and spans both Azure and AWS cloud infrastructure.
* Participate in the design and implementation of advanced mechanisms for data ingestion and transformation, and mass parallel orchestration of network IO.
* Maintaining Infrastructure as Code and working with infrastructure teams to develop valuable new features for Client's Engineering Platform.
* Model data for a variety of purposes (operational and analytical) in collaboration with your team, other teams, and analytical data customers.
* Contribute to CLIENT's data platform in a way that promotes the development of a data mesh architecture for the entire enterprise.
* Work on indicators of data quality across our estate and improve the quality of our data along key metrics.
* Evaluate the quality (completeness and accuracy) of potential new data sources for specific applications.
* Contribute to quality automation in our CI/CD process, optimising for bug-free release cadence and developer delight.
* Maintain good quality documentation (starting with your code) for technical and non-technical audiences.
* Participate in a pairing-first development team, learning skills from your colleagues and giving back to the community by imparting hard-won wisdom and skills learned from past experiences.
* Mentoring and coaching of less experienced team members through design and code reviews
* Participate in a safe and honest workplace culture by participating in open conversations about technical design, implementation and interrogating decisions when appropriate.
* Contribution to test automation through either enhancement to the platform or additional tests
* Assessment of application security to ensure it complies with CLIENT Application Security Standards
* Evaluation of APIs to ensure that they comply with the relevant CLIENT API Standards
Skills & Ability
* You are able to grasp, articulate, and advocate for technological solutions in both technical and non-technical settings and intelligently apply agile principles as you do so.
* You are able to interrogate and present data and data analysis and have a willingness to present results of analysis undertaken as a part of your team's work.
* You have demonstrable experience as a senior software developer or engineer with a focus on Python.
* SQL (Postgres, SQL Server, Databricks)
* comfortable working without an ORM.
* familiar with the challenges of working with data *at scale*.
*prefer the command line use of git, bash/zsh, and (optionally) vim.
* An undergraduate degree or demonstrable knowledge and experience of concepts in Computer Science, Software Engineering, Logic, Applied Statistics, Actuarial Science, Data Science, or any related discipline would be advantageous.
Qualification
- Key responsibilities and Accountabilities
- Working with multiple stakeholder communities to understand our data needs and create pipelines to take data between different layers in the platform
- Ensuring the technical infrastructure is in place and appropriate to support managing the data platform and associated activities such as pipelines
- Creating standards and patterns to ensure that future development adhere to a high quality fit for purpose framework
- Defining features and capabilities to move the dial on data usage within the insurance industry
- Providing governance and consultancy to users of the data platform and data related questions
Skills and Ability - Communication client has a broad range of stakeholders with a commitment to becoming data driven The successful candidate will need to be able to work with a broad stakeholder group and align between multiple viewpoints
- Collaborative client prides itself on its collaborative culture and data engineers will regularly interact with other technical teams and business users
- Willingness to learn the successful candidate will be expected to propose new approaches and prototype solutions
- Influence A key part of this role will be to influence the strategic usage of data within client at both a technical and cultural level This role will be a mixture of hands on development and thought leadership
Knowledge and Experience - Three or more years working in a Data Engineering role
- Experience designing and using Azure capabilities and especially Analytics tools including Synapse Analytics
- Strong SQL knowledge ideally with SQL Server and Azure SQL experience
- Knowledge of Python and ideally Spark
- Experience analyzing cleaning migrating and modeling data
- Experience working in an Agile environment
Key job details
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa is an Equal Opportunity Employer. All applicants will receive fair and impartial treatment without regard to race, color, religion, sex, national origin, ancestry, age, legally protected physical or mental disability, protected veteran status, status in the U.S. uniformed services, sexual orientation, gender identity or expression, marital status, genetic information or on any other basis which is protected under applicable federal, state or local law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government-issued ID during each interview. All candidates must be authorized to work in the USA.
Learn more
Awards and recognition
Syncing your Virtusa Information
Syncing Complete
Exporting your personal Virtusa brand items
Export Complete
Check your downloads folder for files and implementation instructions.
Assets are now available in your profile for future editing and use.
Loading your existing headshots
Please select any one of the images below
Downloading Secure Assets
Signing out