- Design, implement, and maintain scalable and reliable data pipelines from our production databases (PostgreSQL/MongoDB/TimeStream) using AWS Glue.
- Collaborate with software engineering, data science and BI teams to understand data requirements and ensure data availability and quality.
- Develop and deploy machine learning models using AWS SageMaker.
- Manage and optimise AWS infrastructure components to ensure performance, scalability, and cost-effectiveness.
- Implement and maintain monitoring and logging solutions for the data and machine learning pipelines.
- Proven experience as a Data Engineer or Machine Learning Engineer, with a focus on AWS technologies.
- Hands-on experience with AWS services such as S3, Glue, Redshift, SageMaker, Aurora and others.
- Proficient in Python and Terraform / CDK
- Strong understanding of data modelling, ETL processes, and data warehousing concepts.
- Experience deploying and managing machine learning models in production.
- Working in a hybrid environment with a split of in-office and working from home. Our philosophy on working is one built around connection, inclusion and flexibility.
- Holistic wellness support for you and your family through our wellbeing partnership with Acacia Connection
- Generous parental leave entitlements including 16 weeks primary caregiver leave and continued superannuation contributions
- Annual learning and development budget to support your professional growth
- Paid volunteer leave to support the causes that matter to you
-
Senior Data Engineer
4 days ago
https:/www.bebee/join Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Senior Data Engineer
2 days ago
Virtusa Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Manager, Data Engineering
5 days ago
Map Talent Sydney, Australia**Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...
-
Data Engineering Manager
3 days ago
Macquarie Group Limited Sydney, AustraliaJoin our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...
-
Data Engineering Manager
6 days ago
The Argyle Network Sydney, Australia-The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...
-
Data Engineering Analyst
1 week ago
Cognizant Technology Solutions Sydney, AustraliaWhat makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...
-
Manager, Data Engineering and Operations
1 day ago
BT Financial Group Barangaroo, Australia**How will I help?** · We have an exciting opportunity for a Manager, Data Engineering and Operations, to join our team on a permanent basis · Some of your key responsibilities will include: · - Support and improve aspects of an agile Teradata SQL database environment and its ope ...
-
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Ability to prioritize in complex, fast-paced environment. · - Computer literate, confident with Office Suite · The Data Center Engineering Operations Train ...
-
CBOE Sydney, AustraliaWe design, develop, deploy, and support data engineering systems. We support equities market exchange trading platforms in Australia and Japan and collaborate with similar teams in the US and EU regions. · We architect systems that can deal with billions of events per day. We sto ...
-
Data Center Engineering Operations Trainee
3 days ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast-paced environment. · - Physical ...
-
Data Center Engineering Operations Trainee
3 days ago
Amazon Corporate Services Pty Ltd Sydney, AustraliaInterest in maintenance of a Data Center or Critical space facility. · - Strong verbal and written communication skills. · - Strong attention to detail. · - Strong leadership and organizational skills. · - Facilities Management mindset. · - Ability to prioritize in complex, fast- ...
-
Data Engineer
3 days ago
Deputy Sydney, AustraliaAt Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, s ...
-
Data Engineer
4 days ago
Lendaly Pty Sydney, AustraliaImprove upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required. · Responsibilities · Design, build, and maintain scalable data pipelines to collect, process, ...
-
Data Engineer
2 days ago
Practiv Limited Sydney, AustraliaAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...
-
Data Engineer
5 days ago
VirtusaPolaris - Virtusa Corporation Sydney, AustraliaRole Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...
-
Data Engineer
2 days ago
PayTech Nexus Ltd Sydney, AustraliaTerm: 12 months · Experience Requirement: 3-5 years · Job location: Sydney, Australia · Project scope: Data Engineering in Credit Risk Environment · Background · We are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-mon ...
-
Data Engineer
4 days ago
Loadsmile Sydney, AustraliaAbout Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...
-
Data Engineer
3 days ago
Nine Sydney, AustraliaNine is Australia's largest locally owned media company – the home of Australia's most trusted and loved brands spanning News, Sport, Lifestyle, and Entertainment. We pride ourselves on creating the best content, accessed by consumers when and how they want – across Publishing, B ...
-
Data Engineer
6 days ago
TMGM Sydney, Australia Full timeJoin our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, ...
-
Data Engineer
1 week ago
Virtusa Sydney, AustraliaData Engineer - CREQ186610 Description Role Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kuberne ...
Data Engineer - Sydney, Australia - Ofload
Description
About Ofload and our mission:
At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry.
Every day in Australia, around 30% of trucks travel empty and a further 50% are idle amounting to mass inefficiency and harmful environmental impacts.
Since 2020, we've successfully removed over 5 million empty kms from Australian roads. Our customer base has expanded to over 250 businesses, and we proudly support small business carriers by connecting them with household brands like Asahi, Metcash, and Noumi.
As part of our sustainability commitment, we partnered with Trace to measure, reduce and offset our scope 1, 2 and 3 emissions, actively working to minimise our own environmental impact.
In 2022, we propelled our growth through the strategic acquisition of a Melbourne-based logistics company, and raised $60m in Series B funding. Notably, we were recognised by the Australian Financial Review as one of Australia's Most Innovative Companies.
Fast forward to 2023, Ofload was named a Deloitte Tech Fast 50 Company in Australia, and secured the 4th spot on the LinkedIn Top Startups List 2023. And here's the exciting part – we're just getting started
We are looking to grow our team and welcome people excited by the opportunity to transform the logistics industry. If you're ready to be part of a dynamic team driving change, join us on this incredible journey
The Role:
We're currently looking for a talented Data Engineer / Machine Learning Engineer to help leverage our accumulated shipment data to build out a best in class AWS Data Warehouse for use by our Data Science and BI teams.
We are developing some game changing prediction and recommendation engines to disrupt the freight industry and there is an opportunity for the right candidate to get hands-on with not just the ETL process but to also collaborate with our Data Scientists to assist in feature engineering and optimise models for production deployment.
Responsibilities:
Requirements:
Life at Ofload:
At Ofload, our values are in our DNA and underpin the work we do every day. We are proud of the collaborative, diverse and innovative culture we continue to build. The Ofload team is motivated by a shared ambition to digitise the logistics industry and have a truckload of fun while doing it As well as the opportunity to join a high-growth organisation with the ability to make a meaningful impact everyday, you will enjoy;
Plus all the exciting perks of joining a startup - epic Ofload swag, weekly catered breakfasts, monthly team lunch, a reward and recognition program and plenty of social events.
Ofload is committed to building diverse and inclusive teams, and a culture where people can bring their whole authentic selves to work each day. Applications are highly encouraged from Aboriginal and Torres Strait Islander people; and equity target groups including women, people from culturally and linguistically diverse backgrounds, people with disabilities, and people who identify as LGBTIQ.
We endeavour to create an equitable recruitment process with an even playing field for all candidates. If you require any adjustments to be made, please let a member of our recruitment team know.