- Various social events to promote networking, the celebration of wins, and sometimes just for fun
- Design, develop, and maintain data pipelines for extracting, transforming, and loading data from various sources into lake house.
- Create and implement data models to support business requirements and data analysis needs.
- Integrate data from multiple systems (internal & external) to provide a unified and consistent view of information.
- Ensure data accuracy, consistency, and compliance with data governance policies.
- Optimize data infrastructure and processes to improve data processing and query performance.
- Build scalable and reliable data systems capable of handling large volumes of data.
- Implement security measures to protect sensitive data and ensure data privacy and confidentiality.
- Collaborate with BI developers, data modelers, data scientists, infrastructure engineers, key business stakeholders, application teams, and technology partners to understand data requirements and provide necessary data assets.
- Evaluate and recommend new data engineering technologies and tools to enhance data capabilities.
- Troubleshoot data-related issues and provide solutions to maintain smooth data operations.
- Support data-driven decision-making processes by ensuring data availability and accessibility in suitable formats for analytical and integration purposes.
- Minimum of 5 years' experience as a Data Engineer, demonstrating familiarity with the Microsoft Azure cloud platform.
- Excellent understanding of Azure databricks – Py spark, Spark SQL, Cluster Management, query optimizations, performance tuning.
- Preferred experience in designing Data Lake or Lake House solutions utilizing Azure Databricks.
- Expert level data Integration skills using Azure Data Factory or similar tools – Design parameterized multi-level data movement pipelines, Triggers, Monitoring, Alerts.
- Fundamental knowledge of Azure DevOps or equivalent tools.
- Experience in scripting data transformations using Python and Spark SQL.
- Demonstrated expertise in SQL and ETL techniques.
- Experience of extracting data from REST API endpoints.
- Ability to work autonomously within a team environment.
- Driven and results oriented personality.
- Open to feedback and always looking for ways to improve own performance.
- Analytical and curious mindset.
- Strong interpersonal skills.
- Strong knowledge and experience on data analysis and analysis frameworks.
-
Engineering Data Analyst
1 week ago
Zoom Recruitment Brisbane, Australia**_DO YOU LOVE DATA ANALYTICS & SPREAD SHEETING????????_** · **If so, this could be the job for you** · Zoom Recruitment are proud to be partnering with a leading ASX listed energy infrastructure company. They manage and operate a diverse portfolio of gas, electricity, solar and ...
-
Data Engineering Manager
3 days ago
Endeavour Foundation Cannon Hill, AustraliaPerfect role for an **experienced **Data Engineering Leader **who is passionate about creating, building, and maintaining data-driven projects. · - ** Flexible** Work Environment · - Fun &** Friendly Team** Culture with** Ongoing Support** and Training · **Who is Endeavour Founda ...
-
BOEING Brisbane, AustraliaAt Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity and inclusion are shared values. We're committed to fostering an environment for every teammate ...
-
Boeing RIV Site Brisbane, AustraliaAbout us · As one of the country's leading and preferred defence partners, Boeing Defence Australia (BDA) develops and sustains leading edge technologies for some of Australia's largest and most complex defence projects. · Recently identified as one of the top 20 places to work i ...
-
BOEING Brisbane, AustraliaAt Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity and inclusion are shared values. We're committed to fostering an environment for every teammate ...
-
Data Engineer
6 days ago
Jumbo Interactive Limited Brisbane City, AustraliaPlay A Key Part In Building & Maintaining The Data Infrastructure That Underpins Our Success - In-Depth Knowledge Of PostgreSQL Is Essential · 15th April, 2024 · Why us? · We're an innovative technology company that has achieved remarkable growth over the past 25 years, starting ...
-
Data Engineering
1 week ago
Firesoft People Brisbane City, Australia· Job Description: · My client is about to embark on updating its cloud platform. This project will see you working with the latest & greatest if you are looking for something to kick off your new Financial year... This upgrade project is for you To be successful in this role yo ...
-
Data Engineering
5 days ago
Firesoft People Brisbane, Australia Full timeMy client is about to embark on updating its cloud platform. This project will see you working with the latest & greatest if you are looking for something to kick off your new Financial year... This upgrade project is for you · To be successful in this role you will have - · Wr ...
-
data engineer
1 week ago
Jumbo Interactive Brisbane, Australia Full timePlay A Key Part In Building & Maintaining The Data Infrastructure That Underpins Our Success - In-Depth Knowledge Of PostgreSQL Is Essential · 15th April, 2024 · Why us? · We're an innovative technology company that has achieved remarkable growth over the past 25 years, starting ...
-
Data Engineer
5 days ago
Green Light Queensland, Australia Full time2 years contract · Australian citizens, must have at least Baseline security clearance · Various locations in Australia · Green Light Worldwide are looking for an experienced Data Engineers to assist in a service delivery of a large national project at one of our client sites. · ...
-
Data Engineer
1 week ago
Vero Insurance Brisbane City, Australia Max Term Full timeJobs - Job Details - Data Engineer Careers at Suncorp · Take the next step. Be part of something bigger at Suncorp. · Data Engineer · Job No: 671180 · Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various · Max Term Full Time · Hum ...
-
Data Engineer
5 days ago
Credit Union Australia Brisbane, AustraliaAbout the role... As a Data Engineer, you will support all aspects of the management and effective operation of our Enterprise Data Platforms, including data ingestion, pipeline management, system integration and platform administration. · You will support the delivery of busine ...
-
Senior Data Engineer
1 week ago
Blackroc Brisbane City, AustraliaDatabase Development & Administration (Information & Communication Technology) · BLACKROC are seeking a Senior Data Engineer for a global technology business who will play a crucial role in designing, building, and optimising data infrastructures, collaborating with senior stake ...
-
Head of Data Engineering
5 days ago
Bupaoptical Brisbane City, AustraliaAn exciting, permanent opportunity has becomeavailable for a Head of Data Engineering. · Bupa has a strategic goal of being the most customer-centric digital healthcare organisation, with the use of data as an explicit pillar of this strategy. This role will provide leadership an ...
-
Senior Data Engineer
1 day ago
Michael Page Brisbane City, AustraliaEngineering - Software (Information & Communication Technology) · Excellent opportunity to join Digital and Data led organisation as they continue their large scale migration to a newly created Global Azure Data Platform. · This globally recognised organisation is an industry le ...
-
Data Platform Engineer
5 days ago
u&u Brisbane, Australia Full timeu&u. Recruitment Partners are proud to be working with Transmax to uncover a Data Engineer with Databricks experience to join a high performing product team · Transmax are a genuine Brisbane success story and employer of choice enjoying significant growth through product innovati ...
-
Azure Data Engineer
2 days ago
PRA Australia Brisbane City, AustraliaA world-renowned retail organisation are looking for a Data Engineer to join their Enterprise Data Platform team. This is a great time to join the organisation as it grows and utilises Data in new ways. · The ideal candidate will be skilled using Azure resources such as Azure SQ ...
-
Senior Data Engineer
4 days ago
Michael Page Brisbane, Australia PermanentAbout Our Client · This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025. · A large part of ...
-
Data Platform Engineer
6 days ago
Profusion Group Brisbane, AustraliaData Platform Engineer · 12 month initial daily rate contract – up to $900p/day + super · Brisbane based role · Data Platform experience required, ideally within Financial Services/Banking · Company Overview · Our client is a leading financial institution committed to serving ...
-
Senior Data Engineer
3 days ago
Michael Page Brisbane, Australia Full timePermanent position · Brisbane CBD location · About Our Client · This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Dat ...
Senior Azure Data Engineer - Queensland, Australia - PM&E
Description
Opportunity
to attend global awards events, including Global Gathering .A day in the life...
Who You Are...
Who we are...
Since our beginning, our vision has always been to open up the world for those who want to see.
As a global travel retailer, our people come from all different backgrounds, and our connections spread to the far reaches of the globe - 20+ countries and counting Together, we are a family (we call ourselves Flighties).
Irreverence. Ownership. Egalitarianism.
#LI-LR1 #LI-Hybrid