- Design, build, and maintain scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various sources.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data solutions meet business needs.
- Implement and optimise data models, data architecture, and data warehousing solutions for efficient data retrieval and analysis.
- Monitor data systems' performance, identify bottlenecks, and implement solutions to optimise data processing and storage.
- Ensure data security and privacy measures are in place to safeguard sensitive information and comply with relevant regulations.
- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
- Strong programming skills in languages such as Python, Java, Scala, or SQL for data manipulation and analysis.
- Proficiency in working with big data technologies, such as Hadoop, Spark, or similar distributed computing frameworks.
- Experience with data modeling, data warehousing, and ETL development using tools like Apache Airflow or similar.
- Knowledge of database systems like MySQL, PostgreSQL, MongoDB, or Cassandra.
-
Senior Data Engineer
4 days ago
https:/www.bebee/join Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Senior Data Engineer
3 days ago
Virtusa Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Manager, Data Engineering
6 days ago
Map Talent Sydney, Australia**Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...
-
Data Engineering Manager
6 days ago
The Argyle Network Sydney, Australia-The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...
-
Data Engineering Manager
3 days ago
Macquarie Group Limited Sydney, AustraliaJoin our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...
-
Data Engineering Analyst
1 week ago
Cognizant Technology Solutions Sydney, AustraliaWhat makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...
-
Manager, Data Engineering and Operations
1 day ago
BT Financial Group Barangaroo, Australia**How will I help?** · We have an exciting opportunity for a Manager, Data Engineering and Operations, to join our team on a permanent basis · Some of your key responsibilities will include: · - Support and improve aspects of an agile Teradata SQL database environment and its ope ...
-
Data Center Engineering Operations Trainee
3 days ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast-paced environment. · - Physical ...
-
Data Center Engineering Operations Trainee
3 days ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong attention to detail. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast- ...
-
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Ability to prioritize in complex, fast-paced environment. · - Computer literate, confident with Office Suite · The Data Center Engineering Operations Train ...
-
CBOE Sydney, AustraliaWe design, develop, deploy, and support data engineering systems. We support equities market exchange trading platforms in Australia and Japan and collaborate with similar teams in the US and EU regions. · We architect systems that can deal with billions of events per day. We sto ...
-
Data Engineer
3 days ago
Deputy Sydney, AustraliaAt Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, s ...
-
Data Engineer
4 days ago
Loadsmile Sydney, AustraliaAbout Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...
-
Data Engineer
2 days ago
Practiv Limited Sydney, AustraliaAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...
-
Data Engineer
2 days ago
PayTech Nexus Ltd Sydney, AustraliaTerm: 12 months · Experience Requirement: 3-5 years · Job location: Sydney, Australia · Project scope: Data Engineering in Credit Risk Environment · Background · We are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-mon ...
-
Data Engineer
5 days ago
VirtusaPolaris - Virtusa Corporation Sydney, AustraliaRole Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...
-
Data Engineer
1 week ago
TMGM Sydney, Australia Full timeJoin our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, ...
-
Data Engineer
3 days ago
Nine Sydney, AustraliaNine is Australia's largest locally owned media company – the home of Australia's most trusted and loved brands spanning News, Sport, Lifestyle, and Entertainment. We pride ourselves on creating the best content, accessed by consumers when and how they want – across Publishing, B ...
-
Data Engineer
23 hours ago
Sirius People New South Wales, Australia Full timeData Engineer - Contract - Initial 3 month contract to transition to a permanent position. · Sirius Technology is partnering with a leading mission driven organisation who are expanding on their IT capabilities from a Data perspective. They are looking for a skilled Data Enginee ...
-
Data Engineer
5 days ago
Nine Sydney, Australia Full timeJob Description · Data Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine's data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into ...
Data Engineer - Sydney, Australia - Lendaly Pty
Description
Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required.