Jobs
>
Sydney

    Data Engineer - Sydney, Australia - Woolworths Group Limited

    Woolworths Group Limited
    Woolworths Group Limited Sydney, Australia

    1 day ago

    Woolworths Group Limited background
    Full time
    Description

    Data Engineer

  • Permanent role
  • Hybrid and flexible working environment
  • Sydney (Norwest) office location

    • About Woolworths

    Woolworths Group is a food and everyday needs retailer united by the shared purpose of creating better experiences together for a better tomorrow. With more than 1,400 stores across its Woolworths Supermarkets, Countdown Supermarkets (New Zealand) and BIG W brands, and fast-growing eCommerce businesses, Woolworths Group is Australia and New Zealand's largest retailer. A top 10 company on the Australian Securities Exchange (ASX), Woolworths Group employs more than 180,000 team members and serves more than 20 million customers a week.

    About the role

    The Risk Analytics team helps the risk community across Woolworths Group use data to make risk-informed choices with confidence and helps them focus on what matters most. The team drives the organisation towards the effective use of data and analytics to support decision-making and early detection of issues across Woolworths Group

    We are searching for a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and infrastructure on GCP to support our organisation's data-driven initiatives.

    Responsibilities will include, but are not limited to:

  • Design and develop scalable, reliable, and efficient data pipelines using GCP technologies such as BigQuery, Cloud Dataflow, Cloud Storage, and Pub/Sub.
  • Architect and implement data models, schemas, and structures that support optimal data storage, retrieval, and analysis.
  • Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and implement solutions that meet business needs.
  • Optimise data workflows and ensure data quality, integrity, and security throughout the entire data lifecycle.
  • Perform data modelling, schema design, and performance tuning to support efficient data storage and retrieval.
  • Implement data governance practices and ensure compliance with Group Data Management policies
  • Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to ensure system stability and performance.
  • Ensure data quality and integrity by implementing robust data validation, cleansing, and governance processes.
  • Stay up to date with the latest advancements in GCP technologies and provide recommendations for adopting new tools and frameworks to enhance data engineering capabilities.
  • Develop and maintain documentation for data engineering processes, workflows, and solutions.

    • Who we are looking for

    We are looking for an experienced Data Engineer, with proven technical capabilities, alongside excellent problem-solving skills and the ability to analyse complex data-related issues.

    This role will work on a variety of data engineering projects within the risk team and will collaborate closely with data science and analytics team members.

    Requirements:

  • Proven experience in data engineering, with a focus on designing and implementing solutions on Google Cloud Platform.
  • Strong proficiency in GCP services such as BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, and Data Catalog.
  • Solid understanding of data modelling, ETL/ELT processes, and data integration techniques.
  • Proficiency in programming languages such as Python, Java, or Scala, with experience in writing efficient and scalable code.
  • Experience with version control systems Git) and CI/CD practices.
  • Familiarity with data governance, data security, and compliance frameworks.
  • Ideally a Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

    • Grow with the Group

    As an inclusive, team-first company

  • Virtusa

    Senior Data Engineer

    3 days ago

    Virtusa Sydney, Australia

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...

  • https:/www.bebee/join

    Senior Data Engineer

    4 days ago

    https:/www.bebee/join Sydney, Australia

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...

  • Map Talent

    Manager, Data Engineering

    6 days ago

    Map Talent Sydney, Australia

    **Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...

  • Macquarie Group Limited

    Data Engineering Manager

    4 days ago

    Macquarie Group Limited Sydney, Australia

    Join our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...

  • The Argyle Network

    Data Engineering Manager

    6 days ago

    The Argyle Network Sydney, Australia

    -The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...

  • Cognizant Technology Solutions

    Data Engineering Analyst

    1 week ago

    Cognizant Technology Solutions Sydney, Australia

    What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...

  • BT Financial Group

    Manager, Data Engineering and Operations

    1 day ago

    BT Financial Group Barangaroo, Australia

    **How will I help?** · We have an exciting opportunity for a Manager, Data Engineering and Operations, to join our team on a permanent basis · Some of your key responsibilities will include: · - Support and improve aspects of an agile Teradata SQL database environment and its ope ...

  • Amazon Corporate Services Pty Ltd

    Data Center Engineering Operations Trainee

    3 days ago

    Amazon Corporate Services Pty Ltd Sydney, Australia

    Interest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast-paced environment. · - Physical ...

  • Amazon Corporate Services Pty Ltd

    Data Center Engineering Operations Trainee

    3 days ago

    Amazon Corporate Services Pty Ltd Sydney, Australia

    Interest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong attention to detail. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast- ...

  • Amazon Corporate Services Pty Ltd

    Data Center Engineering Operations Trainee

    1 day ago

    Amazon Corporate Services Pty Ltd Sydney, Australia

    Interest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Ability to prioritize in complex, fast-paced environment. · - Computer literate, confident with Office Suite · The Data Center Engineering Operations Train ...

  • CBOE

    Manager Software Engineering, Data Pipeline

    1 day ago

    CBOE Sydney, Australia

    We design, develop, deploy, and support data engineering systems. We support equities market exchange trading platforms in Australia and Japan and collaborate with similar teams in the US and EU regions. · We architect systems that can deal with billions of events per day. We sto ...

  • Deputy

    Data Engineer

    3 days ago

    Deputy Sydney, Australia

    At Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, s ...

  • VirtusaPolaris - Virtusa Corporation

    Data Engineer

    5 days ago

    VirtusaPolaris - Virtusa Corporation Sydney, Australia

    Role Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...

  • Virtusa

    Data Engineer

    11 minutes ago

    Virtusa Sydney, Australia

    Data Engineer - CREQ186610 Description Role Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kuberne ...

  • Practiv Limited

    Data Engineer

    2 days ago

    Practiv Limited Sydney, Australia

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...

  • Suncorp Group

    Data Engineer

    3 days ago

    Suncorp Group Sydney, Australia Max Term Full time

    Full-time 12-month contract · Flexible working locations of Brisbane, Sydney or Melbourne · Modern building with state of the art facilities · At Suncorp, we're seeking a Data Engineer to play a pivotal role in delivering top-quality customer complaints data that drives our comm ...

  • Ofload

    Data Engineer

    3 days ago

    Ofload Sydney, Australia Full time

    About Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...

  • Mane Consulting

    Data Engineer

    3 days ago

    Mane Consulting Sydney, Australia Full time

    Are you a customer-obsessed data engineer who can focus on the delivery and innovation of new services? Can you use your Snowflake experience and knowledge to advise, design, and implement cost-effective solutions to our customers, whilst maintaining an excellent delivery posture ...

  • Loadsmile

    Data Engineer

    4 days ago

    Loadsmile Sydney, Australia

    About Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...

  • Zone It Solutions

    Data Engineer

    3 days ago

    Zone It Solutions Sydney, Australia Full time

    We are looking for Data Engineer for Sydney location for a large-scale project. · This is a permanent role with a global IT service leader. · Key responsibilities: · Designing, building and maintaining data architectures, including databases and processing systems; · Acquiring a ...