- Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform
- Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc
- Ability to work independently and also contribute to overall architecture and design
- Experience in writing Shell scripts in Linux Platform
- Knowledge on API management concepts and design
- Developed Apache Spark applications and comfortable developing in Python. (Preferred)
- Performed debugging and performance tuning of Spark applications. Primary Location Sydney, New South Wales, Australia Job Type Fresher Years of Experience 5 Qualification
- Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform
- Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc
- Ability to work independently and also contribute to overall architecture and design
- Experience in writing Shell scripts in Linux Platform
- Knowledge on API management concepts and design
- Developed Apache Spark applications and comfortable developing in Python. (Preferred)
- Performed debugging and performance tuning of Spark applications. Travel No
-
Senior Data Engineer
1 day ago
https:/www.bebee/join Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Senior Data Engineer
13 hours ago
Virtusa Sydney, AustraliaSenior Data Engineer - CREQ183850 Description ETL Dev and Testing · Teradata · Scala · Python · SQL · Selenium · Test automation · Datawarehousing / BI experience · Spark · Hadoop / Big Data / HDFS · Cloud migration experience · AWS Cloud experience · Primary Location ...
-
Data Engineering Manager
3 days ago
The Argyle Network Sydney, Australia-The Argyle Network · Sydney, Australia · Posted 9 hours ago Permanent Competitive Salary + Bonus · - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank**The Client**: · Leading Aussie Bank de ...
-
Manager, Data Engineering
2 days ago
Map Talent Sydney, Australia**Job title**: · **Manager, Data Engineering** · **Job type**: · - Perm**Emp type**: · - Full-time**Skills**: · Manager · **Salary type**: · - Annual**Salary**: · - AUD $170,000.00**Job published**: · - 24/11/2023**Job ID**: · - 34455**Data Engineering Manager - Sydney - $180,000 ...
-
Data Engineering Manager
13 hours ago
Macquarie Group Limited Sydney, AustraliaJoin our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almo ...
-
Data Engineering Analyst
5 days ago
Cognizant Technology Solutions Sydney, AustraliaWhat makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, ...
-
Data Engineer
2 days ago
VirtusaPolaris - Virtusa Corporation Sydney, AustraliaRole Name: Data Engineer · Must have 5+ years of experience in below mentioned skills. · Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 · Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Auro ...
-
Data Engineer
5 days ago
Woolworths Group Limited Sydney, Australia Full timeData Engineer · Permanent role · Hybrid and flexible working environment · Sydney (Norwest) office location · About Woolworths · Woolworths Group is a food and everyday needs retailer united by the shared purpose of creating better experiences together for a better tomorrow. ...
-
Data Engineer
11 hours ago
Zone IT Solutions Sydney, AustraliaWe are looking for Data Engineer for Sydney location for a large-scale project. This is a permanent role with a global IT service leader. · Key responsibilities: · Designing, building and maintaining data architectures, including databases and processing systems; · Acquiring and ...
-
Data Engineer
2 days ago
Practiv Sydney, Australia Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...
-
Data Engineer
13 hours ago
Cognizant Sydney, AustraliaJob Description · What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this wo ...
-
Data Engineer
3 days ago
Zone IT Solutions Sydney, Australia Full timeWe are currently seeking a highly motivated and experienced Data Engineer to a full-time position. You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data ...
-
Data Engineer
6 days ago
Practiv Limited Sydney, AustraliaAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand bot ...
-
Data Engineers
6 hours ago
Infosys Singapore & Australia Sydney, Australia Full timeThis is a lead role helping the organisation understand how data products can solve customer and business pain points. The role leads the definition of business requirements, value and outcomes for Data Product families, works with engineering teams to build and test the products ...
-
Data Engineer
2 days ago
ED - Group Support Functions Sydney, Australia Full timeAbout You · You're customer focused and passionate about being part of a tribe of great people and you actively contribute to your workplace community. With a growth mindset, you orient around doing what's meaningful, purposeful and delivers value. You're excited about being pa ...
-
Data Engineer
1 day ago
Loadsmile Sydney, AustraliaAbout Ofload and our mission: · At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry. · Every day in ...
-
Data Engineer
4 days ago
Latitude IT Sydney, Australia Full timeCollaborative, supportive, Values driven environment · Great coffee (and a variety of tea) and fresh fruit · Avoid the traffic: we are outside the CBD and close to public transport · ASAP Start · Minimum Baseline security clearance needed · Initial 6 months contract with a view o ...
-
Data Engineer
11 hours ago
Deputy Sydney, AustraliaAt Deputy, we're on a mission to simplify shift work. We empower businesses to build thriving workplaces - ones where staff are engaged, customers are served well, businesses are legally compliant, and companies' profits thrive. Our reach extends across 70+ countries worldwide, s ...
-
Data Engineer
1 day ago
Lendaly Pty Sydney, AustraliaImprove upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required. · Responsibilities · Design, build, and maintain scalable data pipelines to collect, process, ...
-
Data Engineer
6 hours ago
BWS New South Wales, Australia Full timeData Engineer · Harness huge datasets and work on projects to create innovative retail tools · Experiment with new ideas, taking a test and learn approach to your work · Work collaboratively with other data professionals in an Agile squad setup · We strive to create better experi ...