- Design and develop ETL pipelines in and out of a data warehouse using Azure Data Factory (ADF)
- Ability to write SQL queries against Azure SQL Database / Synapse.
- Provide production support for Azure SQL Database / Synapse issues such as data load problems, transformation, and translation problems.
- Integration of on-premises infrastructure with cloud (Microsoft Azure) infrastructure.
- Effectively translate requirements for Business Intelligence, Reporting and Analytics to database modelling and design.
- Ability to understand data pipelines and modern ways of automating data pipelines using cloud-based and on-premises technologies.
- Actively test and document implementations, so others can easily understand the requirements, implementation, and test conditions.
- Partner with the Data Architects, Product Managers and Scrum Masters to deliver data integrations solutions required for various projects.
- Ensure effective technical and project documentation across all phases of delivery.
- Comprehensive, hands-on experience working as a Microsoft Azure Data Engineer. Ideally, a minimum of 3 years in Data Warehousing, ETL/ELT, BI, and Analytics projects.
- Must have experience with at least one (1) end to end implementation of an Azure Cloud Data Warehouse and two (2) end to end data warehouse implementations.
- Expertise in data modelling, ELT using ADF, implementing complex views, stored procedures and standard DWH and ETL/ELT concepts.
- Extensive design and implementation experience in Azure cloud data platform and modern data warehousing. Including aspects such as Security, Azure Logging and Monitoring, Azure Databricks, Synapse, Azure Blob Storage, Azure Data Lake, Azure Data Factory, Azure SQL Database, Azure Analysis Services, Power BI
- Deep understanding of relational and NoSQL data stores, methods, and approaches (star and snowflake, dimensional modelling).
- Experience with data security and data access controls and design.
- Proficiency in RDBMS, complex SQL queries, database performance tuning and troubleshooting.
- Commercial experience with full-stack MS Power BI modelling (M code), Dax, data storytelling, report publishing, security, and knowledge of how people make decisions with data.
- Provide resolution to an extensive range of complex data pipeline-related problems proactively and as issues surface.
- Must have experience with Agile development methodologies.
- Experience working directly with technical and business teams.
- Strong written communication skills. Is effective and persuasive in both written and oral communication.
- A passion for what we do: "We believe in the positive impact data and analytics can have in the data-driven organisation and individual".
- Trust goes a long way: This starts with our employees and extends by nature to our clients. We are committed to building long-term partnerships based on trust, clear communication, and understanding.
- Creativity and curiosity: Simple solutions to complex problems are possible when the solution design focuses on solving problems and is supported by the correct use of previous experiences and the appetite to keep learning every day.
-
Senior Data Engineer
3 weeks ago
https:/www.bebee/join Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Senior Data Engineer
2 weeks ago
Virtusa Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Manager, Data Engineering
3 weeks ago
Map Talent Sydney, Australia**Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...
-
Data Engineering Manager
3 weeks ago
The Argyle Network Sydney, Australia-The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...
-
Data Engineering Manager
2 weeks ago
Macquarie Group Limited Sydney, AustraliaJoin our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...
-
Data Engineering Analyst
3 weeks ago
Cognizant Technology Solutions Sydney, AustraliaWhat makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...
-
Data Engineering Manager
4 days ago
Macquarie Group Limited Sydney, AustraliaOur Commodities and Global Markets Data Transformation is an exciting program of work as we embark on our journey to build the innovative and future ready Data Platform that will help Macquarie businesses meet customer needs. · Your forward thinking, ability to work collaborative ...
-
Data Engineering Analyst
1 week ago
Evolution Mining Sydney, AustraliaAbout us · Evolution Mining was founded in late 2011 and has operations across Australia and in Ontario, Canada. · We currently operate five wholly owned operations across NSW, QLD, WA and Canada with a leadership team that continually focuses on embedding a values driven culture ...
-
Manager, Data Engineering and Operations
2 weeks ago
BT Financial Group Barangaroo, Australia**How will I help?** · We have an exciting opportunity for a Manager, Data Engineering and Operations, to join our team on a permanent basis · Some of your key responsibilities will include: · - Support and improve aspects of an agile Teradata SQL database environment and its ope ...
-
Data Center Engineering Operations Trainee
1 week ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Ability to prioritize in complex, fast-paced environment. · - Physical Security protocol awareness · - Computer literate, confident with Office Suite · The ...
-
Data Center Engineering Operations Trainee
2 weeks ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast-paced environment. · - Physical ...
-
Data Center Engineering Operations Trainee
2 weeks ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong attention to detail. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast- ...
-
Data Center Engineering Operations Trainee
2 weeks ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · Strong verbal and written communication skills. · Strong attention to detail. · Strong leadership and organizational skills. · Facilities Management mindset. · Ability to prioritize in complex, fast-paced envi ...
-
Data Center Engineering Operations Trainee
2 weeks ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Ability to prioritize in complex, fast-paced environment. · - Computer literate, confident with Office Suite · The Data Center Engineering Operations Train ...
-
Data Center Engineering Operations Trainee
1 week ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaHigh school or equivalent diploma · The Data Center Engineering Operations Trainee will be responsible for Data Center Engineering Operations within an Amazon Data Center including risk management and mitigation, corrective and preventative maintenance of critical infrastructure, ...
-
Manager Software Engineering, Data Pipeline
2 weeks ago
CBOE Sydney, AustraliaWe design, develop, deploy, and support data engineering systems. We support equities market exchange trading platforms in Australia and Japan and collaborate with similar teams in the US and EU regions. · We architect systems that can deal with billions of events per day. We sto ...
-
Manager, Data Analytics Engineering Mta
2 weeks ago
Optus Sydney, Australia**Manager, Data Analytics Engineering MTA**: · **Date**:18-May-2023 · **Location**: Sydney (Macquarie Park HQ), Australia · **Company**:Singtel Group · **About the role**: · As a key member of the Customer Success Insights team, the Manager, Data Analytics Engineering delivers th ...
-
Atlassian Sydney, Australia**Working at Atlassian** · **Atlassian can hire people in any country where we have a legal entity. Assuming you have eligible working rights and a sufficient time zone overlap with your team, you can choose to work remotely or from an office (unless it's necessary for your role ...
-
Data Center Engineering Support Manager
1 week ago
Equinix Sydney, AustraliaData Center Engineering Support Manager · Who are we? · Equinix is the world's digital infrastructure company, operating 200+ data centers across the globe and providing interconnections to all the key clouds and networks. Businesses need one place to simplify and bring together ...
-
Data Center Engineering Operations Trainee
2 days ago
Amazon Corporate Services Pty Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong leadership and organizational skills. · - Strong attention to detail. · - Facilities Management mindset. · - Ability to prioritize in complex, fast- ...
Microsoft Azure Data Engineer - Sydney, Australia - One51 Consulting
Description
We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition, develop and maintain the documentation of the data architecture, data flow, and data warehouse data models appropriate for both technical and business audiences.
Responsibilities:
Required:
About One51
One51 Consulting is home to the collective knowledge and experience of diverse backgrounds but like-minded individuals.
At the core of our culture, we value:
At One51, you will have the opportunity to work with companies in different business sectors in a relaxed and supportive environment.
One51 uses a hybrid working arrangement – primarily working from home, with optional office days scheduled 1-2 days per week at our Sydney office.