Jobs
>
Melbourne

    Azure Data Engineer - Melbourne, Australia - COGNIZANT

    COGNIZANT
    COGNIZANT Melbourne, Australia

    Found in: Talent AU C2 - 5 days ago

    Cognizant background
    Full time
    Description

    Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses.Learn how Cognizant helps clients lead with digital at or follow us @Cognizant

    Position Summary:

    • We are seeking a talented and experienced Azure Cloud and Data Engineer to join our growing team and play a key role in developing and enhancing the Data and Analytics applications for our clients within Insurance domain.
    • The candidate must have a solid background in Python, SQL and strong knowledge in Azure cloud, Data warehousing, data-modelling along with expertise in Azure Synapse.

    Mandatory Skills:

    • 7+ years of experience in Data and analytics roles.
    • Knowledge of Azure data technologies including Azure Data Factory (ADF), adlsGen2, Synapse, and Databricks/ Spark Pools.
    • Hands-on experience in delta-lake supported by Azure Databricks, Azure Synapse (preferred), DevOps including Azure repos, Azure DevOps, Jenkins, Git, and CI/CD processes.
    • Prior extensive experience with Python, SQL, and PySpark.
    • Solid understanding of cloud architecture, demonstrated with Microsoft Azure.
    • Must have experience in Azure Cosmos DB.
    • Proficient in designing, developing, and maintaining data pipelines using Azure Data factory.
    • Must have 4+ years of programming knowledge in Python/PySpark.
    • Good exposure to Data frames and Spark SQL.
    • Must have experience in technically leading Duck Creek development & test teams.
    • Leveraging prior experience in providing hands on support and guidance to the Duck Creek platform team on best practices for solution delivery (development and testing) in the context of Duck Creek on-demand billing, policy active & clarity.
    • Experience with containerization and associated microservice tooling such as Docker, and Kubernetes.
    • More than 2 years of domain knowledge in Insurance project is highly required.
    • Hands-on experience in SQL and NoSQL DBS.
    • Prior experience in streaming - Kafka.
    • Excellent Knowledge of ADF building components- integration runtime, linked services, Data sets, pipelines,and activities.
    • Strong customer-facing skills with ability to define and work through business requirements and problem statements with clients.

    Duties and Responsibilities:

    • Lead end-to-end development and implementation of insurance project in Azure cloud.
    • Optimization of data-pipeline using databricks, ensuring high performance, and scalability.
    • Collaborate with data scientists and analytics to provide accessible, clean, and integrated data for advanced analytics.
    • Practical experience in executing cloud deployments using Azure DevOps pipeline or GitHub actions.
    • Enabling development & testing for Duck Creek on demand implementation including DevOps.
    • Ensure data quality and integrity, implementing appropriate data governance and security measures used to create policy.
    • Implement CI/CD pipelines for AKS.
    • Create pipelines in ADF using linked services/datasets/pipeline to extract transform and load data from different sources like Azure SQL, blob storage.
    • Provide support for optimal pipeline, dataflows and complex data transformations and manipulation using ADF and PySpark with data bricks, using Polybase to load tables in Azure synapse.
    • Implement framework to automate job using different triggers like events, schedules and tumbling in ADF.
    • Implement Azure data factory extensively for ingesting data from different source systems like relation and unstructured data to meet business requirements.
    • Create store procedure, lookup, execute pipeline, Dataflow Azure function features in ADF.
    • Experienced in troubleshooting and creating database objects within SQL server, Azure SQL, or Synapse SQL pools.
    • Contribute to design reviews, stakeholder meetings and agile processes.

    Salary Range : >$100,000

    Next steps :

    If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you Please apply directly with us.

    For a complete list of open opportunities with Cognizant, visit is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.

    About Cognizant

    Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses. Learn how Cognizant helps clients lead with digital at or follow us @Cognizant.

  • ClearCompany

    Data Engineer

    Found in: Jobleads AU C2 - 7 hours ago

    ClearCompany City of Melbourne, Australia

    Data Engineer required to enable efficient access to transparent, reliable and scalable data within a leading retail business. · Data Engineer required to enable efficient access to transparent, reliable and scalable data within a leading retail business. · Responsibilities:asse ...

  • Konnexus

    Data Engineer

    Found in: JobGet AU C2 - 23 hours ago

    Konnexus Melbourne, Australia

    Data Engineer (ETL) - Permanent Opportunity / Hybrid · Developers/Programmers (Information & Communication Technology) · Our client is a global organisation within the wholesale distribution sector who is currently in the early stage of building up their data & analytics capabil ...

  • Ippon Technologies SAS

    Data Engineer

    Found in: JobGet AU C2 - 6 days ago

    Ippon Technologies SAS Melbourne, Australia

    Ippon Australia is a team of true technologists who leverage contemporary thinking and tools to enhance the way our clients drive value. Whether it's a bespoke platform to improve employee engagement within a national retail chain, or developing an app that provides next level di ...

  • Green Light

    Data Engineer

    Found in: Talent AU C2 - 5 days ago

    Green Light Victoria, Australia Full time

    2 years contract · Australian citizens, must have at least Baseline security clearance · Various locations in Australia · Green Light Worldwide are looking for an experienced Data Engineers to assist in a service delivery of a large national project at one of our client sites. · ...

  • FourQuarters Recruitment

    Data Engineer

    Found in: Talent AU C2 - 1 day ago

    FourQuarters Recruitment Melbourne, Australia Full time

    IT & Telecomms · Consultant - BI / CRM · Melbourne · Permanent / Full Time · Hybrid working model · Strong SQL skills essential · Must have strong dimensional modelling skills · Data Engineer required to enable efficient access to transparent, reliable and scalable data withi ...

  • FourQuarters Recruitment

    Data Engineer

    Found in: Talent AU C2 - 1 day ago

    FourQuarters Recruitment Melbourne, Australia

    IT & Telecomms · Consultant - BI / CRM · Melbourne · Contract or Temp · Very flexible working arrangements · Must have experience working on Azure Databricks · Experience coding in Pyspark essential · Data Engineer required to build data pipelines to ingest data from source s ...

  • Energy Australia

    Data Engineer

    Found in: Talent AU C2 - 2 days ago

    Energy Australia Victoria, Australia

    About the role - 6 Month Contract: · 'Powering EnergyAustralia to make better data driven decisions towards a greener energy future' · Reporting to the Data Engineer Leader – Customer, the Data Engineer will work closely with the Data Product team to support, design, build and de ...

  • Hostplus

    Data Engineer

    Found in: Talent AU C2 - 2 days ago

    Hostplus Melbourne, Australia Full time

    How will you make an impact? · Are you passionate about using data to making a positive impact to our members' dignified retirement? · Hostplus seeks a Data Engineer with strong experience on the Microsoft Azure tech stack to design and drive data integration solutions that will ...

  • Oracle

    Data Engineer

    Found in: Talent AU C2 - 17 hours ago

    Oracle Melbourne, Australia Regular Employee

    As a member of the IGIU (Infrastructure Global Industry Unit) you will interact with different teams from across all parts of the business (including Marketing, Sales, Operations and product development) to identify questions and issues for data analysis and experiments. Develops ...

  • Estia Health

    Data Engineer

    Found in: Talent AU C2 - 17 hours ago

    Estia Health Victoria, Australia Full time

    About the role · As our Data Engineer you will design, build and optimise data pipelines, enabling business users to make informed business decisions based on high-quality data. From data extraction and transformation to integration and modelling, you will collaborate cross-funct ...

  • Grant Executive Search

    data engineer

    Found in: Talent AU C2 - 1 day ago

    Grant Executive Search Melbourne, Australia Full time

    Leading Investment Organisation · Attractive Salary Package plus bonus & Lifestyle Balance · New and challenging Data Engineer career role · This Top Tier Investment Organisation is experiencing continued growth, as a leader in the design, build and maintenance of the highest lev ...

  • Estia Investments

    Data Engineer

    Found in: Talent AU C2 - 17 hours ago

    Estia Investments Victoria, Australia Full time

    Join us in delivering exceptional care and support to our 6,700 residents and 8,000 employees across 73 aged care facilities. Let's pave the way as we enrich and celebrate life together - not just for the residents in our care, but for all future generations of older Australians ...

  • Cerner

    Data Engineer

    Found in: Talent AU C2 - 5 days ago

    Cerner Melbourne, Australia Full time

    As a member of the IGIU (Infrastructure Global Industry Unit) you will interact with different teams from across all parts of the business (including Marketing, Sales, Operations and product development) to identify questions and issues for data analysis and experiments. Develops ...

  • Cognizant

    Data Engineering

    Found in: Talent AU C2 - 5 days ago

    Cognizant Victoria, Australia Full time

    Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative ...

  • Virtusa

    Data Engineer

    Found in: Talent AU C2 - 5 days ago

    Virtusa Melbourne, Australia

    Data Engineer Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform · Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc · Ability to work independen ...

  • Softtest pays pty ltd

    Data Analyst Data Engineer senior data analyst senior data engineer

    Found in: Talent AU C2 - 5 days ago

    Softtest pays pty ltd Melbourne, Australia Full time

    Australian Citizens residing in Australia only respond. · Data Analyst Manager · Data Engineering Expert · Senior Data Analyst Manager · Senior Data Engineering Expert · Citizen · ACT, QLD, SA, VIC · Services Australia is seeking to identify suitable Candidates to perform the rol ...

  • Ciandt

    Lead Data Engineer

    Found in: JobGet AU C2 - 6 days ago

    Ciandt Melbourne, Australia

    We partner with the world's most valuable brands to build digital solutions that transform businesses. As a digital native, we bring a 29-year track record of accelerating business impact through complete and scalable digital solutions. With a global presence of 6,000+ profession ...

  • CI&T Software S.A.

    Lead Data Engineer

    Found in: JobGet AU C2 - 6 days ago

    CI&T Software S.A. Melbourne, Australia

    We partner with the world's most valuable brands to build digital solutions that transform businesses. As a digital native, we bring a 29-year track record of accelerating business impact through complete and scalable digital solutions. With a global presence of 6,000+ profession ...

  • Shankar Pillai

    Senior Data Engineer

    Found in: JobGet AU C2 - 2 days ago

    Shankar Pillai Melbourne, Australia

    Database Development & Administration (Information & Communication Technology) · An incredible opportunity for a strong Senior Data Engineer who has excellent business acumen and experience around financial data. · About the client: · We have partnered with a consulting firm th ...

  • ClearCompany

    Senior Data Engineer

    Found in: JobGet AU C2 - 7 hours ago

    ClearCompany City of Melbourne, Australia

    Senior Data Engineer required to design, develop and implement big data analytics applications on AWS for a well-known financial services business. · Senior Data Engineer required to design, develop and implement big data analytics applications on AWS for a well-known financial s ...