Job Description

About the job Databricks Architect

Title: Databricks Architect
Key Requirements: Hands on experience in Databricks, SQL, PySpark. Must have Insurance domain experience.
Location: Jersey City, NJ
Job Type: Hybrid (2 days work from office)
Duration: 12+ Months
Start Date: Immediate
Number of roles: 1

Role & Responsibilities Overview:

Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
Continuously improve systems through performance enhancements and cost reductions in compute and storage
Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
Lead Data Engineering Projects to manage and implement data-driven communication systems
Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
Integrate data across different systems and platforms
Strong verbal and written communication skills to manage client discussions

Candidate Profile:

8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
Experience in insurance domain/ data is must
Programming Languages SQL, Python
Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
Project Management using Agile, Scrum
B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
Excellent communication & leadership skills, with the ability to lead and motivate team members
Ability to work independently with some level of ambiguity and juggle multiple demands

Inizio Partners

Job Tags

Immediate start,

Similar Jobs

Splinter A Trucking

Class A Crude Oil Driver Job Job at Splinter A Trucking

Class A Crude Oil Driver JobSplinter A Trucking is hiring safety minded drivers for full time positions for hauling crude oil locally... ..., tank gauging, testing oil for BS&W content, loading oil into tanker truck with 3 inch hose and PTO pump, drive safely to unload...

Headway

LPNP (Virtual) Job at Headway

...or grow a full-time practice, Headway makes it easy to accept insurance, boost your earnings, and focus on care - without the administrative... ...Secure competitive rates with top insurance plans through our nationwide network. Predictable bi-weekly payments: Receive reliable...

Nissan of Fort Myers

Title Clerk Job at Nissan of Fort Myers

...Discounts on products and services* Family owned and operated* Long term job securityResponsibilities* Process registration title paperwork for new and used vehicles, and submit to DMV * Maintain titles and MSOs for inventory* Follow up on late Titles,...

AECOM

Resident General Manager (Washington) Job at AECOM

...Restaurant Associates Position Title: Resident General Manager Pay 17 Reports To: VP Of Operations Salary: $135,000 - $150,000 Other Forms of Compensation: Bonus Plan Become part of Restaurant Associates, the industry's leading provider of dining and event...

Hope At Home Health Care

Pediatric Home Infusion Nurse Job at Hope At Home Health Care

...license* 1 year of Infusion therapy experience and training* Strong communication and patient care skills* Pediatric experience is a MUSTHOPE At Home Health Care is a full service home care agency dedicated to helping people excel in the comfort of their home. We...

Databricks Architect Job at Inizio Partners, Jersey City, NJ

RTZqNU5TOTJYbGZPbk9PMGNGakIxVXNnSlE9PQ==