- Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our data warehouse.
- Maintain and build on our data warehouse and analytics environment.
- Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
- Identify, design, and implement process improvements such as: improving database performance, optimising data delivery and re-designing infrastructure for greater scalability, and maintainability among many things
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources within our AWS and data warehouse ecosystem.
- Implement and monitor best in class security measures in our data warehouse and analytics environment, with an eye towards the evolving threat landscape.
- Work with stakeholders including the Engineering, Product, Data Analytics and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Help data analysts troubleshoot their SQL, Python, or R code.
- Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database. We use Snowflake, Redshift, DynamoDB, MySQL and DBT.
- Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools.
- Advance data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together.
- Demonstrated ability to write clear code that is well-documented and stored in a version control system. We use Git.
- Use APIs to push and pull data from various data systems and platforms.
- Experience in building and maintaining a dimensional data model using type 2 dimensions.
- Demonstrated ability to learn new techniques and troubleshoot code without support, ex. find answers to common programming challenges on Google. In other words, be able to learn on the job.
- Excellent listening, interpersonal, communication and problem solving skills.
- Demonstrated ability to work effectively in teams, in both a lead and support role.
- Demonstrated ability to work independently and be a self-starter.
- Software engineering, data science, data analytics experience
- Experience in Docker
- Knowledge of building data lake or data warehouse.
- Knowledge of handling streaming data.
- Experience in Infrastructure as Code and CICD practice.
- ML or predictive analytics experience.
- Experience in web or mobile application development.
-
Senior Data Engineer
Found in: Talent AU C2 - 6 days ago
Virtusa Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Data Engineer
Found in: JobGet AU C2 - 6 days ago
ClearCompany Sydney, AustraliaData Engineer - Contract - Initial 3 month contract to transition to a permanent position. · Sirius Technology is partnering with a leading mission driven organisation who are expanding on their IT capabilities from a Data perspective. They are looking for a skilled Data Enginee ...
-
Data Engineer
Found in: JobGet AU C2 - 4 days ago
Practiv Limited Sydney, AustraliaAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...
-
Data Engineer
Found in: Talent AU C2 - 6 days ago
Deputy Sydney, Australia Full timeResponsibilities · : Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our data warehouse. · Maintain and build on our dat ...
-
Data Engineer
Found in: JobGet AU C2 - 5 hours ago
VirtusaPolaris - Virtusa Corporation Sydney, AustraliaRole Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...
-
Data Engineer
Found in: JobGet AU C2 - 5 days ago
Nine Sydney, AustraliaNine is Australia's largest locally owned media company – the home of Australia's most trusted and loved brands spanning News, Sport, Lifestyle, and Entertainment. We pride ourselves on creating the best content, accessed by consumers when and how they want – across Publishing, B ...
-
Data Engineer
Found in: Talent AU C2 - 5 days ago
Zone IT Solutions Sydney, Australia Full timeWe are currently seeking a highly motivated and experienced Data Engineer to a full-time position. As a Data Engineer, you will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficie ...
-
Data Engineer
Found in: JobGet AU C2 - 4 days ago
Itbility Sydney, AustraliaData Engineer · Permanent · Sydney · Job description : · *Passionate about building next generation data platforms across the bank · *Enthusiastic, be able to contribute and learn from wider engineering talent in the team · *Ready to execute state-of-the-art coding practices, dri ...
-
Data Engineer
Found in: Talent AU C2 - 2 days ago
The Drive Group Sydney, Australia Full timeJob description · One of Australia's most influential businesses is scaling, and they are looking for a great Data Engineer to join the team · Working with the delivery team, you will be building, deploying and then maintaining highly scalable data pipelines on a variety of proje ...
-
Data Engineer
Found in: Jobs Search AU C2 - 1 day ago
Advertising Industry Careers Sydney, Australia Full timeNine is Australia's largest locally owned media company – the home of Australia's most trusted and loved brands spanning News, Sport, Lifestyle, and Entertainment. · We pride ourselves on creating the best content, accessed by consumers when and how they want – across Publishing, ...
-
Data Engineer
Found in: Talent AU C2 - 5 days ago
PayTech Nexus Ltd Sydney, Australia Full timeTerm: 12 months · Experience Requirement: 3-5 years · Job location: Sydney, Australia · Project scope: Data Engineering in Credit Risk Environment · Background · We are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-mon ...
-
Data Engineer
Found in: Talent AU C2 - 6 days ago
Ofload Sydney, Australia Full timeAbout Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...
-
Data Engineer
Found in: Talent AU C2 - 8 hours ago
Mane Consulting Sydney, Australia Full timeAre you a customer-obsessed data engineer who can focus on the delivery and innovation of new services? Can you use your Snowflake experience and knowledge to advise, design, and implement cost-effective solutions to our customers, whilst maintaining an excellent delivery posture ...
-
Data Engineer
Found in: JobGet AU C2 - 6 days ago
Infosys Limited Sydney, AustraliaTechnology|Cloud Integration|Azure Data Factory (ADF) · Company · ITL Australia · Requisition ID · 117969BR · About Infosys: · Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 56 countries to navigate their digital tra ...
-
Data Engineer
Found in: Jobs Search AU C2 - 6 days ago
Zone It Solutions Sydney, Australia Full timeWe are looking for Data Engineer for Sydney location for a large-scale project. · This is a permanent role with a global IT service leader. · Key responsibilities: · Designing, building and maintaining data architectures, including databases and processing systems; · Acquiring a ...
-
Data Engineer
Found in: Talent AU C2 - 3 days ago
Sirius People New South Wales, Australia Full timeData Engineer - Contract - Initial 3 month contract to transition to a permanent position. · Sirius Technology is partnering with a leading mission driven organisation who are expanding on their IT capabilities from a Data perspective. They are looking for a skilled Data Enginee ...
-
Data Engineer
Found in: JobGet AU C2 - 5 days ago
PayTech Nexus Ltd Sydney, AustraliaTerm: 12 months · Experience Requirement: 3-5 years · Job location: Sydney, Australia · Project scope: Data Engineering in Credit Risk Environment · Background · We are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-mon ...
-
Data Engineer
Found in: Talent AU C2 - 6 days ago
Finity Sydney, Australia Permanent / Full timeData Engineer (Consultant / Internal) · Finity Consulting is Australia's largest independent actuarial and analytical consultancy and a leader in developing data-driven insights. We work with large and niche insurers and government agencies using best-practice analytics and cutt ...
-
Data Engineer
Found in: Talent AU C2 - 2 days ago
Nine Sydney, Australia Full timeJob Description · Data Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine's data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into ...
-
Data Engineers
Found in: Talent AU C2 - 6 days ago
Infosys Singapore & Australia Sydney, Australia Full timeThis is a lead role helping the organisation understand how data products can solve customer and business pain points. The role leads the definition of business requirements, value and outcomes for Data Product families, works with engineering teams to build and test the products ...
Data Engineer - Sydney, Australia - Deputy
Description
At Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, serving more than 320,000 workplaces.
Deputy is a global SaaS workforce management company headquartered in Sydney, San Francisco, and London, backed by top investors and recently surpassed 100m ARR. We've helped millions of workers across industries and aim to empower 60% of the global workforce. If you're passionate about simplifying shift work and driving industry change, join us at Deputy and help shape the future of hourly employment
MISSION "THE WHY"
As a Data Engineer, you will be working closely with your team (including two Senior Data Engineers), software engineers, product, design, analytics and leadership teams to shape and execute the data strategy at Deputy. You are able to design, architect and build high performance scalable data pipelines while continually building upon Deputy's guiding principles around data.
Responsibilities:Employee Perks
Share Options
Paternity/Maternity Leave Policies
Flexible Work Policy
Company wide Development & Coaching
Hackathons
Awards - "Your Time to Shine & Celebrate Success"
Social Events & variety of social clubs (Books, LGBT, Games, Sports)
Mental Health Support
Munch & Learns
Deputy believes in equal opportunity and that inclusiveness and diversity promotes innovation. Our global team members are from a variety of cultures. And we welcome different perspective and skills.
#LI-Hybrid
#J-18808-Ljbffr