- Experience either leading significant data engineering projects in an enterprise environment
- The ability to mentor and lead a team with best practices for data engineering and site reliability
- Big Data and Hadoop experience with main focus on Spark, Hive, Presto (or other query engines), big data storage formats (such as Parquet, ORC, Avro), Bamboo/Ansible (or other CICD tools)
- Experience working in a cloud based environment (ideally AWS or GCP)
- Excellent Python, SQL and shell scripting skills
- Experience working on ETL tools like Talend/Informatica/Datastage and an understanding of programming languages like Scala
- Broad knowledge of technical solutions, design patterns, and code for complex applications deployed in distributed computing environment.
- Hybrid and flexible working arrangements
- Wellbeing and service bonus leave
- Up to 20 weeks paid parental leave as well as benefits to support you as you transition to life as a working parent
- Paid volunteer leave and donation matching
- Range of benefits to support your physical, psychological and financial wellbeing
Lead Data Engineer - Sydney, Australia - eFinancialCareers Ltd.
Description
Lead Data Engineer
Macquarie Group Limited Sydney, Australia Posted 6 days ago Permanent Competitive Lead Data Engineer
Sydney
Join our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Help us build the next evolution of our Data and Analytics Platforms. Joining our team means you'll get to use innovative approaches to Data Analytics and you will play a lead role in shaping and driving this forward.
At Macquarie, we are working to create lasting value for our communities, our clients and our people. We are a global financial services group operating in 34 markets and with 54 years of unbroken profitability. You'll be part of a supportive team where everyone - no matter what role - contributes ideas and drive outcomes.
What role will you play?
As a Lead Data Engineer reporting to our Engineering Manager, you'll be building, implementing and enhancing enterprise scale data platforms. You'll be working in a DevOps environment where you will have end-to-end accountability for designing, developing, deploying and supporting your data assets, as well as creating templates and implementation methods, standards and frameworks.
You will also engage with various stakeholders and become an expert in your domain whilst supporting the broader data engineering and SRE community. You will continuously evaluate and recommend improvements to infrastructure and processes and lead incident response efforts, including participating in post-mortem analysis.
What you offer
Benefits
In our Corporate Operations Group, you will work at the heart of Macquarie. Join a collaborative team who accelerate digitalisation, sustainability and social impact for the benefit of our people, customers, shareholders and communities. Our teams include technology, digital transformation and data, operations, human resources, business services, corporate strategy and solutions and the Macquarie Group Foundation.
Our commitment to Diversity, Equity and Inclusion
We are committed to providing a working environment that embraces diversity, equity, and inclusion. We encourage people from all backgrounds to apply for a role regardless of their identity, including gender, race, ethnicity, cultural identity, nationality, age, sexual orientation, gender identity, intersex status, marital or family status, neurodiversity, religion or belief, disabilities, or socio-economic background.
If you require adjustments to your working arrangements or the recruitment process, please let us know when applying.
About Macquarie
A career at Macquarie means you'll have the opportunity to develop new skills, explore interesting fields and do challenging work that will impact the lives of people around the world-whether it's accelerating the green energy transition, helping sustain global food supplies, financing social housing projects or investing in essential infrastructure. At Macquarie, we're empowering people to innovate and invest for a better future.
Macquarie is a global financial group providing clients with asset management, retail and business banking, wealth management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory, capital raising and principal investment.
Find out more at
Job no: COG-976358
Work type: Permanent - Full time
Location: Sydney
Category: Data & Analytics, Technology
Group: Corporate Operations Group
Division: Technology
Recruiter: Patrick Lockington
Opening Date: 18/4/2024