Databricks Architect Job at Affine, Delaware, OH

eUx4Slh5QzJzWER4ZlRHdU5OQ0tRcU94SlE9PQ==
  • Affine
  • Delaware, OH

Job Description

We are seeking an experienced Databricks Architect to design, implement, and optimize big data and cloud-based solutions using the Databricks platform. As a Databricks Architect, you will be responsible for creating scalable, efficient, and secure data architectures and workflows in a cloud-based environment, while ensuring best practices in data engineering, governance, and security.

The ideal candidate should have deep expertise in the Databricks ecosystem, strong experience with data processing frameworks (such as Apache Spark), and a solid understanding of cloud infrastructure. You will collaborate with cross-functional teams to design solutions that support large-scale data processing and machine learning workloads.

Key Responsibilities:

  • Lead the design and implementation of data solutions using Azure services, including Azure Synapse Analytics and Azure Databricks, specifically for cost optimization.
  • Define the overall data strategy and architecture for cost optimization projects.
  • Mentor and guide team members on data engineering best practices and cost optimization techniques.
  • Collaborate with cross-functional teams to identify and prioritize cost-saving opportunities through data analysis.
  • Evaluate and implement new data technologies to enhance performance and reduce costs.
  • Ensure compliance with data governance standards and best practices across cost optimization projects.
  • Extensive experience in data engineering, with a focus on Azure technologies and cost optimization projects.
  • Proven leadership skills with a track record of successful project delivery focused on cost savings.
  • Strong expertise in data modelling, ETL processes, and data governance.
  • Excellent communication skills and the ability to collaborate with stakeholders at all levels.

Must Have Skills:

  • Databricks
  • Pyspark
  • Azure
  • ADF/Azure Data Factory
  • Azure Synapse Analytics
  • ETL
  • SQL
  • Solution Architecture
  • Project management

Job Tags

Similar Jobs

Physician Affiliate Group of New York, P.C. (PAGNY)

Ultrasound Technologist Job at Physician Affiliate Group of New York, P.C. (PAGNY)

Physician Affiliate Group of New York (PAGNY) has an opportunity for an Ultrasound Technologist at NYC Health + Hospitals/Harlem. Harlem Hospital is a designated Level 1 Trauma Center and is recognized for providing centers of excellence in the areas of Bariatric ...

Romero General Construction Corp.

Project Engineer/Takeoff (Grading, Paving & Concrete Construction) Job at Romero General Construction Corp.

 ...change orders and estimates to meet changing job requirements. Assist estimators with bid schedules, proposal preparation, and subcontractor/vendor quote comparison. Organize and update takeoff files to ensure traceability and accuracy. Work closely with Project... 

UPS Industrial Services, LLC.

Journeyman Pipefitter Job at UPS Industrial Services, LLC.

 ...greatest asset. Come join our winning team today! About the Role: UPS Industrial Services is seeking skilled and experienced Pipefitter IV to join our team. The ideal candidates will be based locally in the Chalmette, LA area. This person will be able to install... 

C-SUITE ASSISTANTS

Executive Assistant Job at C-SUITE ASSISTANTS

 ...Executive Assistant to COO, Fintech Service Firm, Midtown, New York City The COO of a large global fintech service firm that is headquartered...  .... This is a hybrid role, 4 days in the office, 1 day remote depending on what is going on. About the Job Manage the... 

Ninyo & Moore, A SOCOTEC Company

Environmental Project Manager Job at Ninyo & Moore, A SOCOTEC Company

 ...Ninyo & Moore has an immediate opening for a licensed Project or Senior Project Environmental Engineer or Geologist to assist in the management and growth of our environmental practice in the San Francisco Bay Area. About the Role : The successful candidate will conduct...