SonicJobs Logo
Left arrow iconBack to search

Senior Data Engineer - Databricks

DATAECONOMY
Posted 10 hours ago, valid for 21 days
Location

Raleigh, NC, US

Salary

Competitive

Contract type

Full Time

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.

Sonic Summary

info
  • DATAECONOMY is seeking a Senior/Lead Data Engineer specializing in Databricks for a full-time position in Raleigh, NC.
  • The role requires 7-10+ years of experience in data engineering and offers a salary of $130,000 to $150,000 annually.
  • Key responsibilities include building scalable ETL/ELT pipelines, ingesting data into various layers, and implementing best practices for job orchestration and monitoring.
  • Candidates should have strong skills in Python (PySpark), SQL, and cloud environments such as AWS, Azure, or GCP, along with experience in modern data lakehouse concepts.
  • Nice-to-have skills include familiarity with data governance, metadata management, and orchestration tools like Airflow or dbt.
DATAECONOMY is one of the fastest-growing Data & Analytics company with global presence. We are well-differentiated and are known for our Thought leadership, out-of-the-box products, cutting-edge solutions, accelerators, innovative use cases, and cost-effective service offerings.
 
We offer products and solutions in Cloud, Data Engineering, Data Governance, AI/ML, DevOps and Blockchain to large corporates across the globe. Strategic Partners with AWS, Collibra, cloudera, neo4j, DataRobot, Global IDs, tableau, MuleSoft and Talend.

Senior/Lead Data Engineer — Databricks

Raleigh NC

Full-time
  • Build scalable, production-grade ETL/ELT pipelines using Databricks (PySpark, Spark SQL, Delta Live Tables, Workflows).
  • Ingest structured, semi-structured, and streaming data into Bronze, Silver, and Gold layers.
  • Develop optimized transformations, data quality rules, and reusable framework components.
  • Implement best practices for job orchestration, monitoring, alerting, and automation.
  • Hands-on experience: Spark, Delta Lake, Workflows, Unity Catalog.
  • Strong SQL programming and performance tuning skills.
  • Experience with cloud environments (AWS/Azure/GCP).
  • Experience with modern data lakehouse concepts and distributed systems.
  • Strong understanding of Lakeflow Connect, LSDP/Lakehouse, Medallion Architecture, Data Validations, Genie, and Agent Bricks/RAG use cases.
  • Should be able to explain these concepts using real project examples and architecture decisions.


Requirements

  •  Strong Python (PySpark) and SQL programming
  •  Databricks — Spark, Delta Lake, Workflows, Unity Catalog
  •  ETL/ELT pipeline development — Medallion Architecture (Bronze/Silver/Gold)
  •  Delta Live Tables, Auto-Loader, Structured Streaming
  •  Data modeling — dimensional (star/snowflake), normalization/denormalization
  •  CI/CD, Git, job orchestration
  •  Cloud experience — AWS, Azure, or GCP
  •  7–10+ years in data engineering

Nice-to-Have Skills

  •  Lakeflow Connect, LSDP/Lakehouse, Genie, Agent Bricks/RAG use cases
  •  Data governance, metadata management, Unity Catalog advanced features
  •  Airflow, dbt, or similar orchestration tools
  •  Data security, compliance, and access models
  •  Cost optimization and performance tuning in cloud environments
  •  Corporate/enterprise data warehousing background





Learn more about this Employer on their Career Site

Apply now in a few quick clicks

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.