Lead Data Engineer Job at AIT Global inc., Irving, TX

enMwZ3VCREIxWFpTNk1mTHhNU0RDRmV1REE9PQ==
  • AIT Global inc.
  • Irving, TX

Job Description

Job Title: Lead Data Engineer
Location: Irving, TX - Hybrid

Must have:

  • Expert in Databricks, PySpark and Azure data services like ADF, Synapse etc.
  • Must have lead level experience
  • 8+ years of professional data engineering experience, with proven technical leadership.
  • Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
  • Deep experience with Databricks (design, optimization, notebooks, stored procedures, UDFs, etc).
  • Hands-on experience with ETL tools such as SSIS and Azure Data Factory.
  • Experience working with API calls and Ingesting data from external source systems
  • Experience with SQL, Python and PySpark
  • Experience with building dynamic and scalable solutions for data ingestion and curation
  • Experience in data engineering and MS SQL Server and T-SQL development.
  • Strong understanding of data lake/delta lake architectures and modern data pipelines.
  • Strong understanding of medallion architectures and design patterns.
  • Strong understanding of data modeling techniques.
  • Experience handling large-scale data volumes (millions of records).
  • Proficiency in building and maintaining CI/CD pipelines.
  • Experience with IaC technologies such as Terraform or Pulumi.
  • Exposure to big data tools (Spark, Hadoop, Kafka) preferred.
  • Experience with reporting tools such as Power BI or Tableau a plus.
  • Knowledge of .NET development beneficial for cross-team collaboration.
  • Prior experience working in an Agile development environment required.
  • Strong communication and collaboration skills with the ability to translate technical concepts to business partners.

What Success Looks Like:

  • You're the go-to technical lead for all things related to data design, integration, and performance.
  • You enable consistency and best practices across Azure, Databricks, SQL, ETL, and data engineering domains.
  • You mentor others while remaining hands-on with architecture and solution delivery.
  • You ensure the Internal Analytics platform continues to evolve as a reliable, scalable data source for the organization.

Job Tags

Similar Jobs

Re Focus LLC

SRE background infrastructure engineer Job at Re Focus LLC

 ...java based technologies is very nice NOT looking for a developer, but needs to be able to write scripts. automation mindset SPLUNK, AppDynamics, thousand eyes, Azure stack, bigpanda for consolidating, Personality MATTERS, needs to be approachable... 

Edgility Search

Innovative Education Management, President Job at Edgility Search

 ...empowering parents and students through individualized, high-quality public education in California. Since 1993, IEM has been at the...  ...distributed staff. Excellent communication, interpersonal, and public speaking skills. Unwavering commitment to educational equity and the... 

LTC Language Solutions

American Sign Language (ASL) Interpreter - New York City, NY Job at LTC Language Solutions

 ...Description LTC Language Solutions is looking for skilled American Sign Language (ASL) Interpreters in the NYC area. Here is what you get to do: Provide high-quality, in-person sign language interpretation at various client locations Accurately interpret in... 

Jobs for Humanity

Associate Banker - SAN FRANCISCO, CA Job at Jobs for Humanity

 ...learning the fundamentals of retail banking. Youll help clients manage their money confidently through relationship building,...  ...to licensed bankers. Assist with branch operations including cash handling and ATM management in line with bank procedures.... 

TechINT Solutions Group, LLC

Remote Piloted Vehicles (RPV) Pilot Job at TechINT Solutions Group, LLC

 ...use technologies. TechINT Solutions Group is looking for RPV Pilots to join our Aberdeen Proving Ground, MD team.Job# TI1472 Job...  ...System Pilot, who will operate commercial off the shelf (COTS) remotely piloted vehicles (RPVs), ground stations, and payloads. Pilots...