- Design, develop and maintain data pipelines that extract, load and transform data from various sources into the data warehouses.
- Design and implement data models that align with business requirements and support efficient querying and analysis.
- Create dashboards, reports and visualisations that directly address business problems and inform and drive action.
- Ensure the pipelines are reliable, scalable, and efficient, considering factors including data volume, velocity, and variety.
- Implement data quality checks and validation processes to maintain accurate and reliable data.
- Set up monitoring and alerting to proactively identify and resolve issues.
- Perform root cause analysis for incidents and implement corrective actions.
- Contribute to the technical design and vision for the data platform.
- Collaborate with cross-functional teams, including product managers, data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
- Communicate technical concepts and solutions effectively to non-technical stakeholders.
- Stay updated with emerging data engineering technologies and trends, and evaluate their potential benefits for the organisation's data ecosystem.
- Fluent in at least one programming language (e.g. Python, C#, Java).
- Proficient in SQL
- Understanding of OLTP concepts including normalised schema design.
- Understanding of OLAP concepts and data model design.
- Experience in designing and building data pipelines, ETL processes, and managing data infrastructure.
- Experience with automating workflows, and managing task dependencies using a tool like Apache Airflow.
- A bachelor's or master's degree in computer science, software engineering, data engineering, data science, information technology or a related field.
- Experience with Google Cloud Platform, AWS or Azure including services for data storage, processing, and analytics.
- Experience with cloud deployment and test automation using a CI/CD solution such as Cloud Build or Concourse
- Experience in deploying cloud infrastructure as code (IaC) using Terraform or similar
-
Senior Data Engineer
4 days ago
https:/www.bebee/join Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Senior Data Engineer
2 days ago
Virtusa Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Manager, Data Engineering
5 days ago
Map Talent Sydney, Australia**Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...
-
Data Engineering Manager
6 days ago
The Argyle Network Sydney, Australia-The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...
-
Data Engineering Manager
3 days ago
Macquarie Group Limited Sydney, AustraliaJoin our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...
-
Data Engineering Analyst
1 week ago
Cognizant Technology Solutions Sydney, AustraliaWhat makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...
-
Manager, Data Engineering and Operations
1 day ago
BT Financial Group Barangaroo, Australia**How will I help?** · We have an exciting opportunity for a Manager, Data Engineering and Operations, to join our team on a permanent basis · Some of your key responsibilities will include: · - Support and improve aspects of an agile Teradata SQL database environment and its ope ...
-
Data Center Engineering Operations Trainee
3 days ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast-paced environment. · - Physical ...
-
Data Center Engineering Operations Trainee
3 days ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong attention to detail. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast- ...
-
CBOE Sydney, AustraliaWe design, develop, deploy, and support data engineering systems. We support equities market exchange trading platforms in Australia and Japan and collaborate with similar teams in the US and EU regions. · We architect systems that can deal with billions of events per day. We sto ...
-
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Ability to prioritize in complex, fast-paced environment. · - Computer literate, confident with Office Suite · The Data Center Engineering Operations Train ...
-
Data Engineer
3 days ago
Deputy Sydney, AustraliaAt Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, s ...
-
Data Engineer
4 days ago
Lendaly Pty Sydney, AustraliaImprove upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required. · Responsibilities · Design, build, and maintain scalable data pipelines to collect, process, ...
-
Data Engineer
2 days ago
Practiv Limited Sydney, AustraliaAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...
-
Data Engineer
2 days ago
PayTech Nexus Ltd Sydney, AustraliaTerm: 12 months · Experience Requirement: 3-5 years · Job location: Sydney, Australia · Project scope: Data Engineering in Credit Risk Environment · Background · We are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-mon ...
-
Data Engineer
4 days ago
Loadsmile Sydney, AustraliaAbout Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...
-
Data Engineer
5 days ago
VirtusaPolaris - Virtusa Corporation Sydney, AustraliaRole Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...
-
Data Engineer
6 days ago
TMGM Sydney, Australia Full timeJoin our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, ...
-
Data Engineer
21 hours ago
Sirius People New South Wales, Australia Full timeData Engineer - Contract - Initial 3 month contract to transition to a permanent position. · Sirius Technology is partnering with a leading mission driven organisation who are expanding on their IT capabilities from a Data perspective. They are looking for a skilled Data Enginee ...
-
Data Engineer
5 days ago
Nine Sydney, Australia Full timeJob Description · Data Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine's data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into ...
Data Engineer - Sydney, Australia - Nine
Description
Nine is Australia's largest locally owned media company – the home of Australia's most trusted and loved brands spanning News, Sport, Lifestyle, and Entertainment. We pride ourselves on creating the best content, accessed by consumers when and how they want – across Publishing, Broadcasting and Digital.
Nine's assets include the 9Network, major mastheads such as The Sydney Morning Herald, The Age and The Australian Financial Review, radio stations 2GB, 3AW, 4BC and 6PR, digital properties such as , 9Now, 9Honey, Pedestrian.TV, Drive, subscription video platform Stan and a majority investment in Domain Group.
Our Purpose: We shape culture by sparking conversations, challenging perspectives, and entertaining our communities.
We bring people together by celebrating the big occasions and connecting the everyday moments. Australia belongs here. We bring our purpose to life via three shared values: We walk the talk, turn over every stone and keep it human.
Job Description
Data Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine's data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into our data warehouse. We extract data from the majority of Nine's enterprise systems, centralise it in our data warehouse, and create rich data models for analysis and to inform business operations and strategy.
The team is also responsible for building solutions to surface data to users including dashboards, Slack integrations and automated static reports, as well as providing data feeds to downstream systems for personalising audience experiences and commercialisation.
Role responsibilities
Qualifications
Desirable:
Additional Information
Our Commitment to Diversity and Inclusion:
At Nine, we are committed to fostering a workforce that embraces all aspects of diversity and inclusion and where practices are equitable to ensure our people experience a sense of belonging. From day one, you'll be encouraged to bring your whole self to work and will be supported to perform at your best. Should you require any adjustments to the recruitment process in order to equitably participate, we encourage you to advise us at the time of application.
We encourage applications from Aboriginal and Torres Strait Islander people, people with disabilities, and of all ages, nationalities, backgrounds and cultures.
Disclaimer: We do not accept unsolicited agency resumes and are not responsible for any fees related to unsolicited resumes.
#J-18808-Ljbffr
Data Engineer professionals in Sydney
-
Harish Anand Omkar
IT grad, Instrumentation Engg | Manager- Retail