Jobs
>
Sydney

    Data Engineer - Sydney, Australia - Virtusa

    Default job background
    Description
    Data Engineer - Hadoop Bigdata Platform Description
  • Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform
  • Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc
  • Ability to work independently and also contribute to overall architecture and design
  • Experience in writing Shell scripts in Linux Platform
  • Knowledge on API management concepts and design
  • Developed Apache Spark applications and comfortable developing in Python. (Preferred)
  • Performed debugging and performance tuning of Spark applications.
  • Primary Location Sydney, New South Wales, Australia Job Type Fresher Years of Experience 5 Qualification
  • Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform
  • Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc
  • Ability to work independently and also contribute to overall architecture and design
  • Experience in writing Shell scripts in Linux Platform
  • Knowledge on API management concepts and design
  • Developed Apache Spark applications and comfortable developing in Python. (Preferred)
  • Performed debugging and performance tuning of Spark applications.
  • Travel No


  • https:/www.bebee/join Sydney, Australia

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...

  • Virtusa

    Senior Data Engineer

    13 hours ago


    Virtusa Sydney, Australia

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...


  • The Argyle Network Sydney, Australia

    -The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...


  • Map Talent Sydney, Australia

    **Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...


  • Macquarie Group Limited Sydney, Australia

    Join our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...


  • Cognizant Technology Solutions Sydney, Australia

    What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...

  • VirtusaPolaris - Virtusa Corporation

    Data Engineer

    2 days ago


    VirtusaPolaris - Virtusa Corporation Sydney, Australia

    Role Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...

  • Woolworths Group Limited

    Data Engineer

    5 days ago


    Woolworths Group Limited Sydney, Australia Full time

    Data Engineer · Permanent role · Hybrid and flexible working environment · Sydney (Norwest) office location · About Woolworths · Woolworths Group is a food and everyday needs retailer united by the shared purpose of creating better experiences together for a better tomorrow. ...

  • Zone IT Solutions

    Data Engineer

    11 hours ago


    Zone IT Solutions Sydney, Australia

    We are looking for Data Engineer for Sydney location for a large-scale project. This is a permanent role with a global IT service leader. · Key responsibilities: · Designing, building and maintaining data architectures, including databases and processing systems; · Acquiring and ...

  • Practiv

    Data Engineer

    2 days ago


    Practiv Sydney, Australia Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...

  • Cognizant

    Data Engineer

    13 hours ago


    Cognizant Sydney, Australia

    Job Description · What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this wo ...

  • Zone IT Solutions

    Data Engineer

    3 days ago


    Zone IT Solutions Sydney, Australia Full time

    We are currently seeking a highly motivated and experienced Data Engineer to a full-time position. You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data ...

  • Practiv Limited

    Data Engineer

    6 days ago


    Practiv Limited Sydney, Australia

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...

  • Infosys Singapore & Australia

    Data Engineers

    6 hours ago


    Infosys Singapore & Australia Sydney, Australia Full time

    This is a lead role helping the organisation understand how data products can solve customer and business pain points. The role leads the definition of business requirements, value and outcomes for Data Product families, works with engineering teams to build and test the products ...

  • ED - Group Support Functions

    Data Engineer

    2 days ago


    ED - Group Support Functions Sydney, Australia Full time

    About You · You're customer focused and passionate about being part of a tribe of great people and you actively contribute to your workplace community. With a growth mindset, you orient around doing what's meaningful, purposeful and delivers value. You're excited about being pa ...

  • Loadsmile

    Data Engineer

    1 day ago


    Loadsmile Sydney, Australia

    About Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...

  • Latitude IT

    Data Engineer

    4 days ago


    Latitude IT Sydney, Australia Full time

    Collaborative, supportive, Values driven environment · Great coffee (and a variety of tea) and fresh fruit · Avoid the traffic: we are outside the CBD and close to public transport · ASAP Start · Minimum Baseline security clearance needed · Initial 6 months contract with a view o ...

  • Deputy

    Data Engineer

    11 hours ago


    Deputy Sydney, Australia

    At Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, s ...

  • Lendaly Pty

    Data Engineer

    1 day ago


    Lendaly Pty Sydney, Australia

    Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required. · Responsibilities · Design, build, and maintain scalable data pipelines to collect, process, ...

  • BWS

    Data Engineer

    6 hours ago


    BWS New South Wales, Australia Full time

    Data Engineer · Harness huge datasets and work on projects to create innovative retail tools · Experiment with new ideas, taking a test and learn approach to your work · Work collaboratively with other data professionals in an Agile squad setup · We strive to create better experi ...