Databricks Architect Job at Affine, Delaware, OH

eUx4Slh5QzJzWER4ZlRHdU5OQ0tRcU94SlE9PQ==
  • Affine
  • Delaware, OH

Job Description

We are seeking an experienced Databricks Architect to design, implement, and optimize big data and cloud-based solutions using the Databricks platform. As a Databricks Architect, you will be responsible for creating scalable, efficient, and secure data architectures and workflows in a cloud-based environment, while ensuring best practices in data engineering, governance, and security.

The ideal candidate should have deep expertise in the Databricks ecosystem, strong experience with data processing frameworks (such as Apache Spark), and a solid understanding of cloud infrastructure. You will collaborate with cross-functional teams to design solutions that support large-scale data processing and machine learning workloads.

Key Responsibilities:

  • Lead the design and implementation of data solutions using Azure services, including Azure Synapse Analytics and Azure Databricks, specifically for cost optimization.
  • Define the overall data strategy and architecture for cost optimization projects.
  • Mentor and guide team members on data engineering best practices and cost optimization techniques.
  • Collaborate with cross-functional teams to identify and prioritize cost-saving opportunities through data analysis.
  • Evaluate and implement new data technologies to enhance performance and reduce costs.
  • Ensure compliance with data governance standards and best practices across cost optimization projects.
  • Extensive experience in data engineering, with a focus on Azure technologies and cost optimization projects.
  • Proven leadership skills with a track record of successful project delivery focused on cost savings.
  • Strong expertise in data modelling, ETL processes, and data governance.
  • Excellent communication skills and the ability to collaborate with stakeholders at all levels.

Must Have Skills:

  • Databricks
  • Pyspark
  • Azure
  • ADF/Azure Data Factory
  • Azure Synapse Analytics
  • ETL
  • SQL
  • Solution Architecture
  • Project management

Job Tags

Similar Jobs

Western Construction Group

Skilled Roofer Job at Western Construction Group

 ...Western Specialty Contractors' Austin Roofing branch is looking to add several skilled roofers to our team! Pay Range: $20-30 depending on experience Schedule: ~10 hour shift ~8 hour shift ~ Monday to Friday ~ Weekend availability Typical Duties: Report... 

Dauntless Discovery

eDiscovery Document Review Attorney - Remote Job at Dauntless Discovery

 ...Experienced Document Review Attorney Remote Great opportunity for licensed attorneys interested in getting started with document...  ...high speed internet connection. JOB DETAILS Project-based eDiscovery document review Fully remote work environment* Variable... 

Pocketbook Agency

Executive Personal Assistant to UHNW Family Job at Pocketbook Agency

 ...emotionally intelligent Executive Personal Assistant to work closely with their long-standing family manager...  ...role that blends personal support, household operations, and executive-level coordination in a fast-paced, private home environment. The position requires a high... 

Goals Healthcare

Neurologist Job at Goals Healthcare

 ...Goals Healthcare is Hiring a Neurologist/Neurophysiologist to Join our Team. We provide our doctors with their own room and larger space to feel comfortable while providing patient care. Join a Medical Group that Respects Your Time. Base compensation: $225,... 

HCLTech

Test Engineer Job at HCLTech

 ...HCLTech is looking for a highly talented and self- motivated Test Engineer to join it in advancing the technological world through innovation and creativity. Job Title : Test Engineer Job ID : 1560120BR Position Type: Full-time Location: Redmond, WA...