Jobs
>
Brisbane

    Senior Azure Data Engineer - Queensland, Australia - PM&E

    PM&E
    PM&E Queensland, Australia

    6 days ago

    Default job background
    Full time
    Description

    Opportunity

    to attend global awards events, including Global Gathering .
  • Various social events to promote networking, the celebration of wins, and sometimes just for fun
  • A day in the life...

  • Design, develop, and maintain data pipelines for extracting, transforming, and loading data from various sources into lake house.
  • Create and implement data models to support business requirements and data analysis needs.
  • Integrate data from multiple systems (internal & external) to provide a unified and consistent view of information.
  • Ensure data accuracy, consistency, and compliance with data governance policies.
  • Optimize data infrastructure and processes to improve data processing and query performance.
  • Build scalable and reliable data systems capable of handling large volumes of data.
  • Implement security measures to protect sensitive data and ensure data privacy and confidentiality.
  • Collaborate with BI developers, data modelers, data scientists, infrastructure engineers, key business stakeholders, application teams, and technology partners to understand data requirements and provide necessary data assets.
  • Evaluate and recommend new data engineering technologies and tools to enhance data capabilities.
  • Troubleshoot data-related issues and provide solutions to maintain smooth data operations.
  • Support data-driven decision-making processes by ensuring data availability and accessibility in suitable formats for analytical and integration purposes.
  • Who You Are...

  • Minimum of 5 years' experience as a Data Engineer, demonstrating familiarity with the Microsoft Azure cloud platform.
  • Excellent understanding of Azure databricks – Py spark, Spark SQL, Cluster Management, query optimizations, performance tuning.
  • Preferred experience in designing Data Lake or Lake House solutions utilizing Azure Databricks.
  • Expert level data Integration skills using Azure Data Factory or similar tools – Design parameterized multi-level data movement pipelines, Triggers, Monitoring, Alerts.
  • Fundamental knowledge of Azure DevOps or equivalent tools.
  • Experience in scripting data transformations using Python and Spark SQL.
  • Demonstrated expertise in SQL and ETL techniques.
  • Experience of extracting data from REST API endpoints.
  • Ability to work autonomously within a team environment.
  • Driven and results oriented personality.
  • Open to feedback and always looking for ways to improve own performance.
  • Analytical and curious mindset.
  • Strong interpersonal skills.
  • Strong knowledge and experience on data analysis and analysis frameworks.
  • Who we are...

    Since our beginning, our vision has always been to open up the world for those who want to see.

    As a global travel retailer, our people come from all different backgrounds, and our connections spread to the far reaches of the globe - 20+ countries and counting Together, we are a family (we call ourselves Flighties).

    Irreverence. Ownership. Egalitarianism.

    #LI-LR1 #LI-Hybrid



  • Zoom Recruitment Brisbane, Australia

    **_DO YOU LOVE DATA ANALYTICS & SPREAD SHEETING????????_** · **If so, this could be the job for you** · Zoom Recruitment are proud to be partnering with a leading ASX listed energy infrastructure company. They manage and operate a diverse portfolio of gas, electricity, solar and ...


  • Endeavour Foundation Cannon Hill, Australia

    Perfect role for an **experienced **Data Engineering Leader **who is passionate about creating, building, and maintaining data-driven projects. · - ** Flexible** Work Environment · - Fun &** Friendly Team** Culture with** Ongoing Support** and Training · **Who is Endeavour Founda ...


  • BOEING Brisbane, Australia

    At Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity and inclusion are shared values. We're committed to fostering an environment for every teammate ...


  • Boeing RIV Site Brisbane, Australia

    About us · As one of the country's leading and preferred defence partners, Boeing Defence Australia (BDA) develops and sustains leading edge technologies for some of Australia's largest and most complex defence projects. · Recently identified as one of the top 20 places to work i ...


  • BOEING Brisbane, Australia

    At Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity and inclusion are shared values. We're committed to fostering an environment for every teammate ...

  • Jumbo Interactive Limited

    Data Engineer

    6 days ago


    Jumbo Interactive Limited Brisbane City, Australia

    Play A Key Part In Building & Maintaining The Data Infrastructure That Underpins Our Success - In-Depth Knowledge Of PostgreSQL Is Essential · 15th April, 2024 · Why us? · We're an innovative technology company that has achieved remarkable growth over the past 25 years, starting ...

  • Firesoft People

    Data Engineering

    1 week ago


    Firesoft People Brisbane City, Australia

    · Job Description: · My client is about to embark on updating its cloud platform. This project will see you working with the latest & greatest if you are looking for something to kick off your new Financial year... This upgrade project is for you To be successful in this role yo ...

  • Firesoft People

    Data Engineering

    5 days ago


    Firesoft People Brisbane, Australia Full time

    My client is about to embark on updating its cloud platform. This project will see you working with the latest & greatest if you are looking for something to kick off your new Financial year... This upgrade project is for you · To be successful in this role you will have - · Wr ...

  • Jumbo Interactive

    data engineer

    1 week ago


    Jumbo Interactive Brisbane, Australia Full time

    Play A Key Part In Building & Maintaining The Data Infrastructure That Underpins Our Success - In-Depth Knowledge Of PostgreSQL Is Essential · 15th April, 2024 · Why us? · We're an innovative technology company that has achieved remarkable growth over the past 25 years, starting ...

  • Green Light

    Data Engineer

    5 days ago


    Green Light Queensland, Australia Full time

    2 years contract · Australian citizens, must have at least Baseline security clearance · Various locations in Australia · Green Light Worldwide are looking for an experienced Data Engineers to assist in a service delivery of a large national project at one of our client sites. · ...

  • Vero Insurance

    Data Engineer

    1 week ago


    Vero Insurance Brisbane City, Australia Max Term Full time

    Jobs - Job Details - Data Engineer Careers at Suncorp · Take the next step. Be part of something bigger at Suncorp. · Data Engineer · Job No: 671180 · Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various · Max Term Full Time · Hum ...

  • Credit Union Australia

    Data Engineer

    5 days ago


    Credit Union Australia Brisbane, Australia

    About the role... As a Data Engineer, you will support all aspects of the management and effective operation of our Enterprise Data Platforms, including data ingestion, pipeline management, system integration and platform administration. · You will support the delivery of busine ...


  • Blackroc Brisbane City, Australia

    Database Development & Administration (Information & Communication Technology) · BLACKROC are seeking a Senior Data Engineer for a global technology business who will play a crucial role in designing, building, and optimising data infrastructures, collaborating with senior stake ...


  • Bupaoptical Brisbane City, Australia

    An exciting, permanent opportunity has becomeavailable for a Head of Data Engineering. · Bupa has a strategic goal of being the most customer-centric digital healthcare organisation, with the use of data as an explicit pillar of this strategy. This role will provide leadership an ...


  • Michael Page Brisbane City, Australia

    Engineering - Software (Information & Communication Technology) · Excellent opportunity to join Digital and Data led organisation as they continue their large scale migration to a newly created Global Azure Data Platform. · This globally recognised organisation is an industry le ...


  • u&u Brisbane, Australia Full time

    u&u. Recruitment Partners are proud to be working with Transmax to uncover a Data Engineer with Databricks experience to join a high performing product team · Transmax are a genuine Brisbane success story and employer of choice enjoying significant growth through product innovati ...

  • PRA Australia

    Azure Data Engineer

    2 days ago


    PRA Australia Brisbane City, Australia

    A world-renowned retail organisation are looking for a Data Engineer to join their Enterprise Data Platform team. This is a great time to join the organisation as it grows and utilises Data in new ways. · The ideal candidate will be skilled using Azure resources such as Azure SQ ...


  • Michael Page Brisbane, Australia Permanent

    About Our Client · This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025. · A large part of ...


  • Profusion Group Brisbane, Australia

    Data Platform Engineer · 12 month initial daily rate contract – up to $900p/day + super · Brisbane based role · Data Platform experience required, ideally within Financial Services/Banking · Company Overview · Our client is a leading financial institution committed to serving ...


  • Michael Page Brisbane, Australia Full time

    Permanent position · Brisbane CBD location · About Our Client · This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Dat ...