Lead Data Engineer - Sydney - Clearcompany

    Clearcompany
    Clearcompany Sydney

    2 days ago

    Default job background
    Description

    Lead Data Engineer at a Leading Financial Institution

    Our team is seeking an experienced Data Engineer to lead regulatory initiatives and drive innovation in data engineering, leveraging AI and automation to enhance platform efficiency.

    The successful candidate will:

    • Develop and transform the regulatory reporting platform
    • Collaborate with business and technical teams to deliver complex data solutions
    • Implement and optimize data integration pipelines and data warehouse solutions
    • Oversee the design and architecture of large-scale data solutions using AWS services
    • Drive platform efficiency through automation and AI enhancements
    • Ensure data governance and compliance with internal and external regulations

    Requirements include:

    • Proficiency in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro)
    • Experience with data pipeline orchestration tools such as Airflow
    • Hands-on experience with data integration tools (Talend, DataStage, or Informatica)
    • Strong AWS experience, including EC2, S3, RDS, and EMR
    • Expertise in data modeling techniques and data architecture best practices
    • Knowledge of data lineage, technical metadata, data quality, and reconciliation processes
    • Advanced skills in Spark SQL and Python for data automation
    • Ability to tune and optimize data queries for performance
    • Strong communication and negotiation skills
    • Proven experience in leading cross-platform data solutions and complex projects
    • Ability to mentor and lead technical teams

  • Consulting

    Data Engineer

    1 day ago


    Consulting Sydney Full time

    Job Title: Data Engineer · Experience: 6-15 years of experience in data engineering. · Key Responsibilities: · A seasoned data engineer with expertise in AWS (EMR, S3, Athena, SQL) and ETL development using Spark and Scala. Proficiency in scheduling with Autosys and framework bui ...

  • PayTech Nexus Ltd

    Data Engineer

    1 week ago


    PayTech Nexus Ltd Sydney

    Job Title: Data Engineer in Credit Risk Environment · Location: Sydney, Australia · Contract Duration: 12 months (extendable to 2 years) · About the Role: · We are seeking an experienced Data Engineer/Analyst to join our team. The successful candidate will have a strong backgroun ...

  • SafetyCulture

    Data Engineer

    1 week ago


    SafetyCulture Sydney

    SafetyCulture is a customer and product-led SAAS company. Our mission is to help working teams get better every day, giving front line workers a voice and leaders the visibility to make smart decisions when driving safety, quality, and continuous improvement. · As part of the Da ...

  • Cuscal Limited

    Data Engineer

    3 hours ago


    Cuscal Limited Sydney

    This is a Data Engineer role with one of the leading companies in Australia. · Job Description · We are looking for Mid-level Data Engineers and Associate Data Engineers to join our Data Team. The team's goal is to support the performance, integrity, and security of the organizat ...

  • Culture Amp

    Data Engineer

    3 hours ago


    Culture Amp Sydney

    Job Title: Data Engineer - Data Intelligence · Location: AU · This is a unique opportunity to join Culture Amp, a leading company in Australia, as a Data Engineer in the Data Intelligence team. Our team is responsible for enriching and curating data to build reporting and analyti ...

  • Zone IT Solutions

    Data Engineer

    1 hour ago


    Zone IT Solutions Sydney

    Data Engineer Job Description · We are seeking a highly motivated and experienced Data Engineer to fill a full-time position. · Key Responsibilities: · Design and implement data architectures, including databases and processing systems. · Integrate data from various sources and e ...

  • Clearcompany

    Data Engineer

    11 hours ago


    Clearcompany Sydney

    At LifeByte, we are a dynamic and innovative collective of tech visionaries driven by a relentless pursuit of excellence. Each of us brings a unique set of skills to the table, collaborating on projects that shape the future. · Founded in 2017, we are dedicated to fostering an ec ...

  • Neilson Financial Services

    Data Engineer

    3 days ago


    Neilson Financial Services Sydney

    Job Overview · We are seeking a highly motivated Data Engineer to join our dynamic team and support a global business with data integration, transformation, and reporting across multiple time zones. · This role will work with cutting-edge data tools within Microsoft's suite, incl ...

  • Dxc Technology Inc.

    Data Engineer

    11 hours ago


    Dxc Technology Inc. Sydney

    About DXC Technology · We help global companies run their mission-critical systems and operations while modernizing IT, optimizing data architectures, and ensuring security and scalability across public, private and hybrid clouds. · The world's largest companies and public sector ...

  • Commonwealth Bank

    Data Engineer

    5 days ago


    Commonwealth Bank Sydney

    Data Engineer – Data Operations · You are skilled at delivering solutions using Hadoop & AWS. We are a team of visionary thinkers dedicated to shaping the future of banking. As one of Australia's most advanced big data operations teams, we're passionate about leveraging technolog ...

  • INGRITY

    Data Engineer

    2 days ago


    INGRITY Sydney Full time

    Job Title: Data Engineer (Microsoft Fabric & Azure) · Location: Sydney · Employment Type: Contract · Experience Level: Mid-level (3 - 5 Years Solid Data Engineering experience) · If you are a talented Data Engineer skilled in Microsoft Fabric, Azure and Power BI with a passion fo ...

  • Zone IT Solutions

    Data Engineer

    3 days ago


    Zone IT Solutions Sydney

    We are currently seeking a highly motivated and experienced Data Engineer for a full-time position at Zone IT Solutions. · Key Responsibilities: · Design and Implement Data Architectures: Create data architectures, including databases and processing systems. · Integrate Data from ...

  • black

    Data Engineer

    2 days ago


    black Sydney Full time

    We're on a mission to help working teams get better every day at SafetyCulture. Our technology platform and products empower front line workers to have a voice, and leaders to make informed decisions when driving safety, quality and continuous improvement. · Job Description · As ...

  • SafetyCulture

    Data Engineer

    3 hours ago


    SafetyCulture Sydney

    Job Title: Data Engineer · This is a key role in empowering the Data Analytics team with the right data model for their needs, enabling them to find insights that can make a change to the company. · Responsibilities: · Deliver big data datasets on time and with quality using the ...

  • Tideri Jobbörse

    Data Engineer

    11 hours ago


    Tideri Jobbörse Sydney

    Job Description: · Position Summary · We are seeking a highly skilled and experienced Data Engineer to contribute to our organization's efforts in designing, developing, and maintaining scalable data pipelines and systems. · This role is crucial for assembling complex data sets, ...

  • SafetyCulture

    Data Engineer

    1 day ago


    SafetyCulture Sydney Full time

    About Us · SafetyCulture is a customer and product-led SAAS company. Our mission is to help working teams get better every day. Our technology platform and products give front line workers a voice and leaders the visibility to make smart decisions when driving safety, quality, an ...

  • Macquarie Bank Limited

    Data Engineer

    1 week ago


    Macquarie Bank Limited Sydney

    Key Role in Digital Banking: We are seeking a skilled Data Engineer to join our Omni Channel Data team and contribute to driving our mission as Australia's #1 Digital Bank. · We foster innovation by collaborating with world-class engineers to build high-quality data services and ...

  • Infosys Singapore & Australia

    Data Engineers

    11 hours ago


    Infosys Singapore & Australia Sydney Full time

    Lead Data Product Owner · This is a lead role helping the organisation understand how data products can solve customer and business pain points. · The role leads the definition of business requirements, value and outcomes for Data Product families, works with engineering teams to ...

  • Atlassian

    Data Engineer

    1 week ago


    Atlassian Sydney

    Job Title: Data Engineer · We are hiring a Data Engineer to join our team at Atlassian. As a Data Engineer, you will enable a world-class engineering practice and drive the approach with which we use data. · You will develop backend systems and data models to serve the needs of i ...

  • Lendaly Pty

    Data Engineer

    1 week ago


    Lendaly Pty Sydney

    **Improve Data Systems and Insights** · We are looking for a skilled data professional to improve our existing systems that collect, manage, and convert data for our teams to interpret in a meaningful way. · Responsibilities: · Design, build, and maintain scalable data pipelines ...

  • Macquarie Bank Limited

    Data Engineer

    6 days ago


    Macquarie Bank Limited Sydney

    Job Description · We are seeking an experienced Data Engineer to play a crucial role in the implementation of regulatory epics within our Banking and Financial Services business unit. · Key Responsibilities · Implement data integration tools such as Talend, DataStage or Informati ...

Jobs
>
Sydney
>
Lead data engineer