Jobs
>
Melbourne

    Solution Designer - Melbourne, Australia - XPT Software Australia Pty Ltd

    Default job background
    Description
    Job Description

    We are seeking a talented 10+ years Solution Designer with expertise in Databricks to join our team. The ideal candidate will have a strong background in designing and implementing data solutions using Databricks platform. This role requires a deep understanding of data engineering principles, and cloud-based analytics. As a Solution Designer, you will play a key role in architecting and implementing scalable, efficient, and high-performance data solutions.

    Responsibilities:

    1. Architectural Design: Design end-to-end data solutions using Databricks platform, considering scalability, performance, security, and reliability requirements.

    2. Data Modeling: Define data models, schemas, and structures to support efficient data processing, storage, and retrieval within Databricks environment.

    3. Data Ingestion: Implement data ingestion pipelines from various sources such as databases, streaming platforms, and external APIs into Databricks for analytics and processing.

    4. Data Transformation: Develop data transformation pipelines using Apache Spark and Databricks notebooks to clean, transform, and enrich raw data into meaningful insights.

    5. Data Governance: Implement data governance policies, access controls, and data lineage tracking mechanisms within Databricks to ensure data quality, compliance, and auditability.

    6. Performance Optimization: Optimize data processing workflows, queries, and jobs within Databricks to achieve optimal performance and resource utilization.

    7. Integration: Integrate Databricks with other data platforms, tools, and services within the data ecosystem to enable seamless data flows and interoperability.

    8. Documentation: Document solution designs, data flows, architectural decisions, and best practices for Databricks usage to facilitate knowledge sharing and collaboration within the team.

    9. Collaboration: Collaborate with data engineers, data scientists, business analysts, and stakeholders to understand requirements, design solutions, and deliver value-added insights.

    Qualifications:

    1. Bachelor's degree in Computer Science, Information Technology, or related field.

    2. Proven experience as a Solution Designer or Data Engineer with expertise in Databricks platform.

    3. Deep understanding of big data technologies, distributed computing, and data engineering principles.

    4. Hands-on experience with Apache Spark, Scala/Python programming languages, and Databricks notebooks.

    5. Familiarity with cloud-based data platforms such as Azure Databricks, AWS EMR

    6. Experience in data modeling, ETL/ELT processes, and data integration techniques.

    7. Knowledge of data governance, security, and compliance practices in data management.

    8. Strong analytical, problem-solving, and communication skills.



    Requirements
    We are seeking a talented 10+ years Solution Designer with expertise in Databricks to join our team. The ideal candidate will have a strong background in designing and implementing data solutions using Databricks platform. This role requires a deep understanding of data engineering principles, and cloud-based analytics. As a Solution Designer, you will play a key role in architecting and implementing scalable, efficient, and high-performance data solutions. Responsibilities: 1. Architectural Design: Design end-to-end data solutions using Databricks platform, considering scalability, performance, security, and reliability requirements. 2. Data Modeling: Define data models, schemas, and structures to support efficient data processing, storage, and retrieval within Databricks environment. 3. Data Ingestion: Implement data ingestion pipelines from various sources such as databases, streaming platforms, and external APIs into Databricks for analytics and processing. 4. Data Transformation: Develop data transformation pipelines using Apache Spark and Databricks notebooks to clean, transform, and enrich raw data into meaningful insights. 5. Data Governance: Implement data governance policies, access controls, and data lineage tracking mechanisms within Databricks to ensure data quality, compliance, and auditability. 6. Performance Optimization: Optimize data processing workflows, queries, and jobs within Databricks to achieve optimal performance and resource utilization. 7. Integration: Integrate Databricks with other data platforms, tools, and services within the data ecosystem to enable seamless data flows and interoperability. 8. Documentation: Document solution designs, data flows, architectural decisions, and best practices for Databricks usage to facilitate knowledge sharing and collaboration within the team. 9. Collaboration: Collaborate with data engineers, data scientists, business analysts, and stakeholders to understand requirements, design solutions, and deliver value-added insights. Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or related field. 2. Proven experience as a Solution Designer or Data Engineer with expertise in Databricks platform. 3. Deep understanding of big data technologies, distributed computing, and data engineering principles. 4. Hands-on experience with Apache Spark, Scala/Python programming languages, and Databricks notebooks. 5. Familiarity with cloud-based data platforms such as Azure Databricks, AWS EMR 6. Experience in data modeling, ETL/ELT processes, and data integration techniques. 7. Knowledge of data governance, security, and compliance practices in data management. 8. Strong analytical, problem-solving, and communication skills. 9. Ability to work collaboratively in a cross-functional team environment and drive results

  • ANZ Banking Group

    Solution Designer

    3 days ago


    ANZ Banking Group Melbourne, Australia

    About the role · **Title**: Solution Designer · **Location**: Melbourne · At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a Solution Designer to join our client integration solutions team within the Wholesale Credit and Corp ...

  • Davidson Group Services

    Solution Designer

    1 day ago


    Davidson Group Services Melbourne, Australia

    **Solution Designer -** · **Length: 6 months intially** · **Rate: Up to $1100 per day including Super** · **About the Company**: · Davidson Technology are currently supporting a leading Australian Bank with one of the most advanced technological environments in the country. · We ...

  • Launch Recruitment

    Solutions Designer

    4 days ago


    Launch Recruitment Melbourne, Australia

    2 x roles available · - 1 year contract - until end of March 2024 · - Hybrid working available - 3 days in CBD office · **The company** · Launch is excited to be working with one of Victoria's leading government departments. · **The Role** · Responsibilities include but not limit ...

  • Davidson Recruitment

    Solution Designer

    1 day ago


    Davidson Recruitment Melbourne, Australia

    **About the Company** · Davidson Technology have partnered with One of Australia's big four banks, that offers a wide range of banking and financial services in Australia, New Zealand, the United Kingdom, and Asia. · They are looking for a Solution Designer to join their Fincrime ...

  • CYOS Solutions

    Solution Designer

    3 days ago


    CYOS Solutions Melbourne, Australia

    **Application closing date**:Tuesday, 20 February :59pm, Canberra time · **Estimated start date**: Friday, 01 March 2024 · **Location of work**: VIC · **Length of contract**: 12 months · **Extension term**:2x 12 months · **Security clearance**: Ability to obtain Baseline or NV1 c ...

  • FinXL

    Solution Designer

    3 days ago


    FinXL Melbourne City Centre, Australia

    **Job details**: · - Posted 21 November 2023 · - SalaryNegotiable · - LocationMelbourne CBD · - Job type Temporary · - DisciplineBanking & Financial Services · - ReferenceTR/024591_ · **Job description**: · **Solution Designer** · **Key Deliverables**: · - Lead and collaborate i ...

  • Capgemini

    Solution Designer

    3 days ago


    Capgemini Melbourne, Australia

    About Capgemini · Capgemini is a diverse collective of more than 350,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, conne ...

  • Granite Consulting Australia

    Solution Designer

    4 days ago


    Granite Consulting Australia Melbourne, Australia

    Our well known client in the financial services industry is seeking a Solution Designer responsible for producing a set of target state designs that meet technical and business requirements. The Solution Designer is responsible for the overall integrity of solution so must have k ...

  • Capgemini

    Solution Designer

    4 days ago


    Capgemini Melbourne, Australia

    About Capgemini · Capgemini is a diverse collective of more than 350,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, conne ...

  • Technology People Australia

    Solution Designer

    1 day ago


    Technology People Australia Melbourne, Australia

    Solution Designer role - Permanent - Port Melbourne - Flexible hybrid role · My client is a global retail leader who employ over 20,000 people nationwide looking for a Solution Designer to join their Port Melbourne based team for the next phase of their growth. · Salary will be u ...

  • Granite Consulting

    Solution Designer

    4 days ago


    Granite Consulting Melbourne, Australia

    12 month contract with a chance for extension · - Attractive day rates · - Flexible working arrangements · Our well known client in the financial services industry is seeking a Solution Designer responsible for producing a set of target state designs that meet technical and busin ...

  • Capgemini Australia

    Solution Designer

    4 days ago


    Capgemini Australia Melbourne, Australia

    About Capgemini · Capgemini is a diverse collective of more than 350,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, conne ...

  • Peoplebank

    Solution Designer

    23 hours ago


    Peoplebank Melbourne City Centre, Australia

    Our client a large Australian Government Department looking for a Solution Deisigner to join the team. · Skills and experience include: · - Create and maintain technical design documents and requirements including workflow design of organization & enterprise grade API's · - Parti ...


  • Peoplebank Melbourne City Centre, Australia

    Location: · - Melbourne CBD- Job Type: · - Contract- Posted: · - about 5 hours ago- Contact: · - Tamara McMurtrie- Discipline: · - Security / Cyber Security · - Reference: · **About the Company** · We are currently recruiting for an IAM Solutions Designer for a large enterprise c ...


  • Launch Recruitment Melbourne, Australia

    Flexible, hybrid working environment (CBD office location) · - Technology: Salesforce, APIs, HTML & CSS, DevOps, Agile and more · - Initial 12 month contract (initially) · **About the Company** · This client is responsible for regulating Victoria's building and plumbing industrie ...


  • ANZ Banking Group Melbourne, Australia

    About the role · The ANZx team is seeking talent as we look to reimagine banking for the future. As part of the team you will design and deliver compelling customer-centric solutions focused on improving the financial wellbeing of ANZ's retail and commercial customers. · If you'r ...

  • Capgemini

    Aws Solution Designer

    2 hours ago


    Capgemini Melbourne, Australia

    Let's talk about the role and responsibilities · - Demonstrate ability to define cloud architectures standards and solutions and to get stakeholder agreement on those architectures' standards solutions. · - Demonstrate ability to produce solution designs & artefacts and get it ap ...


  • Peoplebank Melbourne City Centre, Australia

    Location: · - Melbourne CBD- Job Type: · - Contract- Posted: · - about 3 hours ago- Contact: · - Priyanka Arora- Discipline: · - General IT · - Reference: · month Contract · - Melbourne · - Hybrid Working Environment · **About the role**: · - Lead and support operations of the m ...


  • Toll Group Melbourne, Australia

    Company Description · Global Logistics provides sophisticated supply chain solutions, from end-to-end or part solutions, warehousing and distribution to dedicated transport solutions, across the globe and to some of the most remote corners of the world. · RCA provides specialised ...


  • UniSuper Melbourne, Australia

    **Infrastructure & Cloud Solution Designer Lead · - **Work in UniSuper's Solution Design team**: · - **Competitive salary and annual bonus**: · - **Paid development with career direction and growth · **About US** · UniSuper is a place where brilliant thinkers and passionate peopl ...