Lead Data Engineer Job at AIT Global inc., Irving, TX

enMwZ3VCREIxWFpTNk1mTHhNU0RDRmV1REE9PQ==
  • AIT Global inc.
  • Irving, TX

Job Description

Job Title: Lead Data Engineer
Location: Irving, TX - Hybrid

Must have:

  • Expert in Databricks, PySpark and Azure data services like ADF, Synapse etc.
  • Must have lead level experience
  • 8+ years of professional data engineering experience, with proven technical leadership.
  • Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
  • Deep experience with Databricks (design, optimization, notebooks, stored procedures, UDFs, etc).
  • Hands-on experience with ETL tools such as SSIS and Azure Data Factory.
  • Experience working with API calls and Ingesting data from external source systems
  • Experience with SQL, Python and PySpark
  • Experience with building dynamic and scalable solutions for data ingestion and curation
  • Experience in data engineering and MS SQL Server and T-SQL development.
  • Strong understanding of data lake/delta lake architectures and modern data pipelines.
  • Strong understanding of medallion architectures and design patterns.
  • Strong understanding of data modeling techniques.
  • Experience handling large-scale data volumes (millions of records).
  • Proficiency in building and maintaining CI/CD pipelines.
  • Experience with IaC technologies such as Terraform or Pulumi.
  • Exposure to big data tools (Spark, Hadoop, Kafka) preferred.
  • Experience with reporting tools such as Power BI or Tableau a plus.
  • Knowledge of .NET development beneficial for cross-team collaboration.
  • Prior experience working in an Agile development environment required.
  • Strong communication and collaboration skills with the ability to translate technical concepts to business partners.

What Success Looks Like:

  • You're the go-to technical lead for all things related to data design, integration, and performance.
  • You enable consistency and best practices across Azure, Databricks, SQL, ETL, and data engineering domains.
  • You mentor others while remaining hands-on with architecture and solution delivery.
  • You ensure the Internal Analytics platform continues to evolve as a reliable, scalable data source for the organization.

Job Tags

Similar Jobs

Steris Corporation

Service Support Administrator Job at Steris Corporation

 ...Position Summary Behind every great Service Team is an equally impressive support team! Come join our team of Service Support Administrators (SSA) who activate, modify and deactivate equipment maintenance agreement entitlements. In this role you will contribute to the... 

UNC Charlotte

CRM Developer Job at UNC Charlotte

CRM Developer Location Charlotte, NC (University City South area) : The Office of OneIT provides highly reliable information technology infrastructure, tools and services to empower the University to achieve its academic, research, administrative and service goals.... 

People Conquest

Head Waiters Job at People Conquest

PEOPLECONQUEST RH: Were making recruitment process for OCEAN company: Head Waiters Mandatory: Ship Experience or international experience;; English fluence; European citizen(mandatory); More similar cruise ship jobs available on our website.

innovitusa

SharePoint Administrator Job at innovitusa

 ...Visa: Open to any visa type with valid work authorization in the USA DESCRIPTION This position requires a qualified SharePoint Administrator with at least 7 years experience. The SharePoint Administrator will be responsible for designing, maintaining, and... 

Medical Devices Company

Systems Test Engineer Job at Medical Devices Company

 ...Roles & Responsibilities Job Description Work with other test engineers to write test procedures, user manuals and test protocols Build and verify test fixtures Provide support to contract manufacturers Experience Required Other Experience Experience...