Databricks Architect Job at Affine, Delaware, OH

eUx4Slh5QzJzWER4ZlRHdU5OQ0tRcU94SlE9PQ==
  • Affine
  • Delaware, OH

Job Description

We are seeking an experienced Databricks Architect to design, implement, and optimize big data and cloud-based solutions using the Databricks platform. As a Databricks Architect, you will be responsible for creating scalable, efficient, and secure data architectures and workflows in a cloud-based environment, while ensuring best practices in data engineering, governance, and security.

The ideal candidate should have deep expertise in the Databricks ecosystem, strong experience with data processing frameworks (such as Apache Spark), and a solid understanding of cloud infrastructure. You will collaborate with cross-functional teams to design solutions that support large-scale data processing and machine learning workloads.

Key Responsibilities:

  • Lead the design and implementation of data solutions using Azure services, including Azure Synapse Analytics and Azure Databricks, specifically for cost optimization.
  • Define the overall data strategy and architecture for cost optimization projects.
  • Mentor and guide team members on data engineering best practices and cost optimization techniques.
  • Collaborate with cross-functional teams to identify and prioritize cost-saving opportunities through data analysis.
  • Evaluate and implement new data technologies to enhance performance and reduce costs.
  • Ensure compliance with data governance standards and best practices across cost optimization projects.
  • Extensive experience in data engineering, with a focus on Azure technologies and cost optimization projects.
  • Proven leadership skills with a track record of successful project delivery focused on cost savings.
  • Strong expertise in data modelling, ETL processes, and data governance.
  • Excellent communication skills and the ability to collaborate with stakeholders at all levels.

Must Have Skills:

  • Databricks
  • Pyspark
  • Azure
  • ADF/Azure Data Factory
  • Azure Synapse Analytics
  • ETL
  • SQL
  • Solution Architecture
  • Project management

Job Tags

Similar Jobs

Element Care

Personal Care Specialist/CNA/HHA Job at Element Care

 ...Frequent local travel Mandarin/Vietnamese/Khmer or Spanish speaking Preferred. Covid vaccinated preferred. Benefits: Health insurance Dental insurance Vision insurance Paid time off Retirement plan Supplemental benefits EEO Statement... 

JPG Resources - Food & Beverage Innovation

Senior Food Scientist - Product Developer Job at JPG Resources - Food & Beverage Innovation

 ...Job Title: Senior Food Scientist Product Developer Company Overview JPG Resources bridges the gap between ideas and market success in the food & beverage industry. Unlike traditional consultants who stop at strategy, we understand that execution is where... 

Reload transport INC

CDL A Truck Driver Job at Reload transport INC

Looking for a good and reliable driver: - 65 cents per mille - 4 weeks on the road - good driving record - no criminal record

The Planet Group

Environmental Technician Job at The Planet Group

 ...Job Title: Environmental Warehouse Technician Starting Pay: $20/hr plus OT available Location: Holly MI Schedule- M-F 7am-3:30pm Job Description The Environmental Technician consolidates, treats, stores, packs, transports and/or disposes of hazardous... 

AMS Industries, Inc.

Project Estimator Job at AMS Industries, Inc.

 ...preparing accurate cost estimates for mechanical, piping, plumbing, and HVAC systems. This role works closely with project managers, subcontractors, and vendors to ensure competitive, complete, and well-scoped estimates. Key Responsibilities Analyze drawings,...