Jobs
>
Sydney

    Data Engineer- Hadoop Big Data Platform - Sydney, Australia - Virtusa

    Virtusa
    Virtusa Sydney, Australia

    3 days ago

    Default job background
    Description
    Data Engineer- Hadoop Big Data Platform Description
  • Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform
  • Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc
  • Ability to work independently and also contribute to overall architecture and design
  • Experience in writing Shell scripts in Linux Platform
  • Knowledge on API management concepts and design
  • Developed Apache Spark applications and comfortable developing in Python. (Preferred)
  • Performed debugging and performance tuning of Spark applications.
    • Primary Location Sydney, New South Wales, Australia Job Type Experienced Years of Experience 5 Qualification
  • Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform
  • Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc
  • Ability to work independently and also contribute to overall architecture and design
  • Experience in writing Shell scripts in Linux Platform
  • Knowledge on API management concepts and design
  • Developed Apache Spark applications and comfortable developing in Python. (Preferred)
  • Performed debugging and performance tuning of Spark applications.
    • Travel No
  • Evolution Mining

    Data Platform

    4 days ago

    Evolution Mining Sydney, Australia

    About us · Evolution Mining was founded in late 2011 and has operations across Australia and in Ontario, Canada. We currently operate five wholly owned operations across NSW, QLD, WA, and Canada with a leadership team that continually focuses on embedding a values driven culture ...

  • Evolution Mining Limited

    Data Platform

    4 days ago

    Evolution Mining Limited Sydney, Australia

    Evolution Mining Limited · About us · Evolution Mining was founded in late 2011 and has operations across Australia and in Ontario, Canada. We currently operate five wholly owned operations across NSW, QLD, WA, and Canada with a leadership team that continually focuses on embeddi ...

  • AMP

    Principal, Data Platforms

    3 days ago

    AMP Sydney, Australia

    Principal, Data Platforms · If you live in Australia or New Zealand, you've likely heard of AMP. But at a time when society is changing, we are too. We're now a nimbler business with new leadership and thinking. · For us, these are exciting times. There's a real potential for big ...

  • AMP Limited

    Principal, Data Platforms

    5 days ago

    AMP Limited Sydney, Australia

    If you live in Australia or New Zealand, you've likely heard of AMP. But at a time when society is changing, we are too. We're now a nimbler business with new leadership and thinking. · For us, these are exciting times. There's a real potential for big thinkers to help us redefin ...

  • Westpac Banking Corporation

    Executive Manger, Data Platforms

    3 days ago

    Westpac Banking Corporation Sydney, Australia

    Executive Manger, Data Platforms - Digital, Marketing & Customer Engagement · **How will I help?** · The Executive Manager of Digital, Marketing & Customer Engagement in Data Platforms will serve several critical internal clients, including the respective business units across We ...

  • Ayan Infotech

    Data Platform Security Lead

    4 days ago

    Ayan Infotech Sydney, Australia

    Ayan Infotech has an exciting initial 6-month contract opportunity for a Data Platform Security Lead (Azure) in Sydney, CBD. · **Australian citizens can only be considered for this role. It would be ideal if the contractor had a Baseline security clearance.** · The Security SME r ...

  • KPMGau

    Data & Cloud Data Platforms Solution Lead Associate

    22 hours ago

    KPMGau Sydney, Australia

    **Company Description · **KPMG Data & Cloud **is a team with a passion for helping our clients solve their business challenges. We achieve this through business solutions that unlock insights and value from data. Leveraging the "One KPMG" approach, our team works collaboratively ...

  • Maxima

    Indigenous Cadetship/internship Data Platforms

    3 days ago

    Maxima Sydney, Australia InternshipSHIP

    Start your career on the right foot with Westpac Group's supportive cadetship/internship program · Westpac is one of Australia's first and most reputable banks across Australia and New Zealand, operating for over 200 years. The Westpac Group provides high-quality personal, busine ...

  • eFinancialCareers Ltd.

    Principal, Data Platforms

    1 day ago

    eFinancialCareers Ltd. Sydney, Australia

    Job Description · If you live in Australia or New Zealand, you've likely heard of AMP. But at a time when society is changing, we are too. We're now a nimbler business with new leadership and thinking. · For us, these are exciting times. There's a real potential for big thinkers ...

  • Latitude IT

    Data Platform Engineer

    1 day ago

    Latitude IT Sydney, Australia Full time

    Collaborative, supportive, Values driven environment · Great coffee (and a variety of tea) and fresh fruit · Avoid the traffic: we are outside the CBD and close to public transport · Optimize Azure-based data infrastructure. · Drive decision-making with insightful analytics. · Fo ...

  • Macquarie

    Data Platform Analyst

    19 hours ago

    Macquarie Sydney, Australia Full time

    Join our Group Treasury Risk, Reporting, Analytics and Platform Liquidity Data Operations team. Our team focuses on facilitating the delivery of quality and timely liquidity information to fulfil regulatory reporting obligations under a robust risk management framework. · At Macq ...

  • Avanade

    Intelligent Data Platform

    1 day ago

    Avanade Sydney, Australia

    Intelligent Data Platform - Data Engineering ManagerLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting wor ...

  • AMP

    Principal, Data Platforms

    1 day ago

    AMP Sydney, Australia Full time

    If you live in Australia or New Zealand, you've likely heard of AMP. But at a time when society is changing, we are too. We're now a nimbler business with new leadership and thinking. · For us, these are exciting times. There's a real potential for big thinkers to help us redefi ...

  • Avanade

    Intelligent Data Platform

    6 hours ago

    Avanade Sydney, Australia

    Intelligent Data Platform - Data Engineering ConsultantLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting ...

  • Avanade Inc.

    Intelligent Data Platform

    4 days ago

    Avanade Inc. Sydney, Australia Paid Work

    Intelligent Data Platform - Data Engineering Manager · Leading organizations - corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting ...

  • Avanade Inc.

    Intelligent Data Platform

    4 days ago

    Avanade Inc. Sydney, Australia Paid Work

    Intelligent Data Platform - Data Engineering Consultant · Leading organizations - corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interest ...

  • Capgemini

    Data Platform Security lead

    14 hours ago

    Capgemini Sydney, Australia Full time

    About Capgemini · Capgemini is a diverse collective of more than 350,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, conn ...

  • Efinancialcareers Ltd.

    Executive Manger, Data Platforms

    3 days ago

    Efinancialcareers Ltd. Haymarket, Australia Full time

    Executive Manger, Data Platforms - Digital, Marketing & Customer EngagementWestpac Banking CorporationSydney, Australia · Executive Manger, Data Platforms - Digital, Marketing & Customer EngagementWestpac Banking CorporationSydney, AustraliaPosted 1 day agoPermanentCompetitive · ...

  • Westpac Group

    Executive Manger, Data Platforms

    1 day ago

    Westpac Group Sydney, Australia Full time

    How will I help? · The Executive Manager of Digital, Marketing & Customer Engagement in Data Platforms will serve several critical internal clients, including the respective business units across Westpac's Consumer Banking Division. Your team of approximately 100 colleagues sits ...

  • Canva

    Product Platform Data Science Lead

    2 days ago

    Canva Sydney, Australia Full time

    Join the team redefining how the world experiences design. · Hey, hello, hiya, g'day, mabuhay, kia ora, 你好, hallo, vítejte · Thanks for stopping by. We know job hunting can be a little time consuming and you're probably keen to find out what's on offer, so we'll get straight t ...