Lead Data Engineer Job at AIT Global inc., Irving, TX

enMwZ3VCREIxWFpTNk1mTHhNU0RDRmV1REE9PQ==
  • AIT Global inc.
  • Irving, TX

Job Description

Job Title: Lead Data Engineer
Location: Irving, TX - Hybrid

Must have:

  • Expert in Databricks, PySpark and Azure data services like ADF, Synapse etc.
  • Must have lead level experience
  • 8+ years of professional data engineering experience, with proven technical leadership.
  • Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
  • Deep experience with Databricks (design, optimization, notebooks, stored procedures, UDFs, etc).
  • Hands-on experience with ETL tools such as SSIS and Azure Data Factory.
  • Experience working with API calls and Ingesting data from external source systems
  • Experience with SQL, Python and PySpark
  • Experience with building dynamic and scalable solutions for data ingestion and curation
  • Experience in data engineering and MS SQL Server and T-SQL development.
  • Strong understanding of data lake/delta lake architectures and modern data pipelines.
  • Strong understanding of medallion architectures and design patterns.
  • Strong understanding of data modeling techniques.
  • Experience handling large-scale data volumes (millions of records).
  • Proficiency in building and maintaining CI/CD pipelines.
  • Experience with IaC technologies such as Terraform or Pulumi.
  • Exposure to big data tools (Spark, Hadoop, Kafka) preferred.
  • Experience with reporting tools such as Power BI or Tableau a plus.
  • Knowledge of .NET development beneficial for cross-team collaboration.
  • Prior experience working in an Agile development environment required.
  • Strong communication and collaboration skills with the ability to translate technical concepts to business partners.

What Success Looks Like:

  • You're the go-to technical lead for all things related to data design, integration, and performance.
  • You enable consistency and best practices across Azure, Databricks, SQL, ETL, and data engineering domains.
  • You mentor others while remaining hands-on with architecture and solution delivery.
  • You ensure the Internal Analytics platform continues to evolve as a reliable, scalable data source for the organization.

Job Tags

Similar Jobs

Baptist Memorial Hospital - Union City

Emergency Medicine Medical Director in Union City, TN Job at Baptist Memorial Hospital - Union City

 ...into action & advance your leadership skills ! Join TeamHealth as emergency department (ED) medical director at Baptist Memorial Hospital in Union City, Tennessee. If you are trained in Family medicine (FM), Emergency medicine (EM), Internal medicine ( IM) or Internal... 

Paradise Locker, Inc.

Food Safety Support Specialist Job at Paradise Locker, Inc.

 ...Paradise Locker Meats (PLM) is seeking a full-time, highly organized, and detail-oriented individual to support our plant operations and food safety programs. This critical role ensures daily production readiness, regulatory compliance, and product quality. Key... 

Everglades Equipment Group

Outside Sales / Customer Service Representative Job at Everglades Equipment Group

Purpose: Builds customer relationships by traveling to customer locations, perform follow-up activities on complete goods, address customer concerns, promote aftermarket sales, furnish technical support where applicable and collect profiling information to enhance the customer...

Doctors of Physical Therapy

Physical Therapy Technician-Full Time Job at Doctors of Physical Therapy

 ...likes, and trusts each other? Are you passionate about exercise, sports, and the study of anatomy and physiology? If you answered yes...  ...for you! We are currently seeking a Full-Time Physical Therapy Technician for ourVerrado clinic, where our "together we're... 

University of California, Irvine

Senior Patient Escort - Patient Care Equip Pool - FT Nights Job at University of California, Irvine

 ...Equipment Pool Assistant is responsible to receive requests for patient care equipment and supplies and to deliver them to and from...  ...calculators Minimum 6 months of demonstrated experience as a Patient Escort or an Equipment Pool Assistant, in a patient care/hospital...