Cloud & IT Staffing Solutions in Chicago, Boston, Dallas
1

Job Details

Data Engineer (Mid)

Current job openings at Peterson Technology Partners
Current job openings at Peterson Technology Partners
Details
  • Req No : 106311
  • Number of Position : 1
  • Priority : High
Location

Irving, TX 75063, USA

Employment Type
  • Work Authorization Status : greencard, h4ead, l2ead, opt, tnvisa, uscitizen
  • Duration : 6 months
  • Location : Onsite
Technical Profile
  • Professional Experience : 8 years
  • Primary Skills : Python, SQL, Databricks Workflows, ETL/ELT pipelines
  • Other Skills : Databricks, Delta Lake, Kafka, Azure Event Hubs, retail or operational datasets, ML data preparation
  • Additional Notes : contract

Contact

Kevin Patel

Kevin Patel

kevin@ptechpartners.com Kevin Patel on LinkedIn

Data Engineer (Mid)

Location: Irving, TX (Onsite) | Contract

Top Skills: We are looking for someone with very solid SQL skills, building data pipelines, debugging and improving them, and eventually doing end-to-end ETL work, preferably on Databricks.

Overview
Our client is seeking a mid-level Data Engineer to join their Enterprise AI team. In this role, you will build reliable data foundations that power AI-enabled products, operational intelligence, and business decision-making, integrating enterprise data with AI-generated insights and contributing reusable data capabilities across Enterprise AI initiatives.

Responsibilities

  • Build, maintain, and enhance scalable batch and near-real-time data pipelines using Python, SQL, and Spark/PySpark.
  • Integrate data from enterprise applications, operational systems, APIs, event streams, and AI inference outputs into reliable, analysis-ready datasets.
  • Develop transformations that combine structured and semi-structured data across sources using consistent identifiers and timestamps; handle time zones, duplicate records, and late-arriving events.
  • Create and maintain data models and curated datasets for business analytics, AI model development and evaluation, and AI-enabled application workflows.
  • Partner with AI/ML engineers to deliver data interfaces for inference workflows and capture model outputs, confidence scores, and user feedback for analysis and continuous improvement.
  • Implement data quality checks, reconciliation, pipeline monitoring, and alerting to ensure completeness, accuracy, freshness, and traceability.
  • Troubleshoot pipeline failures and performance issues; implement reliable retries, backfills, and incremental processing while optimizing compute and storage costs.
  • Collaborate with product managers, data scientists, analysts, and engineering partners to translate business requirements into practical data solutions.
  • Follow data security, privacy, access-control, and retention requirements when handling enterprise data and AI-generated outputs.
  • Write maintainable, tested code; participate in code reviews and CI/CD practices; document schemas, data lineage, dependencies, and operational runbooks.

Required Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, Engineering, Mathematics, Statistics, or a related quantitative discipline, or equivalent practical experience.
  • 3-5 years of relevant experience in data engineering or a closely related software engineering role.
  • Strong hands-on proficiency in Python and SQL, including complex queries, transformations, and troubleshooting.
  • Experience with Spark/PySpark and distributed data processing.
  • Experience building and supporting ETL/ELT pipelines on a cloud platform such as Azure or AWS.
  • Understanding of data modeling, relational databases, data lakes, data warehouses, and incremental processing patterns.
  • Experience with workflow orchestration tools such as Apache Airflow or Databricks Workflows.
  • Familiarity with event-driven or streaming data processing concepts, including event time, deduplication, and reliable delivery.
  • Experience with Git, automated testing, and production monitoring or troubleshooting.
  • Ability to independently deliver scoped work, communicate technical concepts clearly, and collaborate with technical and business stakeholders.

Preferred Qualifications

  • Hands-on experience with Databricks, Delta Lake, or lakehouse architectures.
  • Experience with Databricks Asset Bundles / Declarative Automation Bundles to define, version, and deploy Databricks jobs and pipelines across environments through CI/CD.
  • Experience with streaming technologies such as Kafka, Azure Event Hubs, or Spark Structured Streaming.
  • Experience with retail, customer, inventory, or operational datasets.
  • Experience preparing datasets for machine learning, anomaly detection, or AI model evaluation.
  • Familiarity with multimodal data, unstructured data processing, or time-based event correlation.
  • Exposure to edge-to-cloud data integration, containerized workloads, or infrastructure as code.

Pay rate: $60/hr. This is a 6-month contract position, onsite in Irving, TX. Candidates must be a Green Card holder, H4 EAD, L2 EAD, OPT, TN Visa, or US Citizen.

About Us

Peterson Technology Partners (PTP) is an Equal Opportunity Employer committed to creating a transparent, inclusive, and human-centered hiring experience.

For nearly three decades, PTP has operated as one of the top IT staffing and recruiting firms in the USA—built on trust, long-term partnerships, and technical excellence.

Based in the Chicago suburb of Park Ridge, IL, our team of more than 500 employees and consultants is dedicated to:

  • Helping every client make the best hiring decisions possible
  • Matching professionals with the right IT jobs and career opportunities

As part of that commitment, we believe in providing clear information about how our hiring technologies work and how your data is used. The following section outlines our AI-assisted interview process and your rights as a candidate.

AI-Assisted Interview Experience (Pete & Gabi – Rebecca):

To provide a consistent, fair, and flexible experience for all candidates, we use AI-assisted tools to support parts of the interview process. This includes our proprietary AI platform Pete & Gabi, which includes AI recruiter Rebecca.

These AI hiring tools help us:

  • Conduct recorded video interviews
  • Transcribe interviews
  • Summarize candidate responses
  • Generate job-related insights
  • Streamline communication and scheduling

Please note that:

  • The AI does NOT make hiring decisions; all decisions are made by our human recruiters, hiring managers, or client partners.
  • The AI does not evaluate facial expressions, emotions, or physical traits; it is used only to support fairness, consistency, and efficiency.

If you prefer a non-AI interview format, we will gladly provide an alternative.

Technical or Case Interviews (Role-Dependent): −

When applying for certain tech jobs, you may participate in:

  • A technical interview
  • A coding challenge
  • A case study
  • A client-specific assessment

We will always explain what to expect in advance so you can prepare with confidence.

Human Review & Selection: +

Every candidate’s profile—including interviews, conversations, and assessments—is reviewed by experienced recruiters and hiring leaders.

AI insights may assist with organization and evaluation, but final decisions are always human-driven.

Your Rights as a Candidate: +

At PTP, every candidate has the right to:

  • Request a non-AI interview path
  • Ask how your data is being used
  • Request access to transcripts or interview recordings
  • Request deletion of your AI-recorded interview
  • Receive clear, timely communication

Our goal is to ensure you feel respected, informed, and supported throughout your experience.

Our Commitment: +

For nearly three decades, PTP has focused on putting people first—candidates, consultants, employees, and clients.

We’re committed to a hiring process that is:

  • Transparent
  • Compliant
  • Equitable
  • Powered by innovative technology that enhances—not replaces—human judgment

Welcome to the future of hiring at Peterson Technology Partners.

We’re excited to learn more about you.

Equal Employment Opportunity: +

Peterson Technology Partners is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, national origin, gender identity, sexual orientation, disability, veteran status, or any other protected characteristic.

Data Engineer (Mid)

Current job openings at Peterson Technology Partners
Current job openings at Peterson Technology Partners
Details
  • Req No : 106311
  • Number of Position : 1
  • Priority : High
Location

Irving, TX 75063, USA

Employment Type
  • Work Authorization Status : greencard, h4ead, l2ead, opt, tnvisa, uscitizen
  • Duration : 6 months
  • Location : Onsite
Technical Profile
  • Professional Experience : 8 years
  • Primary Skills : Python, SQL, Databricks Workflows, ETL/ELT pipelines
  • Other Skills : Databricks, Delta Lake, Kafka, Azure Event Hubs, retail or operational datasets, ML data preparation
  • Additional Notes : contract

Contact

Kevin Patel

Kevin Patel

kevin@ptechpartners.com Kevin Patel on LinkedIn

Data Engineer (Mid)

Location: Irving, TX (Onsite) | Contract

Top Skills: We are looking for someone with very solid SQL skills, building data pipelines, debugging and improving them, and eventually doing end-to-end ETL work, preferably on Databricks.

Overview
Our client is seeking a mid-level Data Engineer to join their Enterprise AI team. In this role, you will build reliable data foundations that power AI-enabled products, operational intelligence, and business decision-making, integrating enterprise data with AI-generated insights and contributing reusable data capabilities across Enterprise AI initiatives.

Responsibilities

  • Build, maintain, and enhance scalable batch and near-real-time data pipelines using Python, SQL, and Spark/PySpark.
  • Integrate data from enterprise applications, operational systems, APIs, event streams, and AI inference outputs into reliable, analysis-ready datasets.
  • Develop transformations that combine structured and semi-structured data across sources using consistent identifiers and timestamps; handle time zones, duplicate records, and late-arriving events.
  • Create and maintain data models and curated datasets for business analytics, AI model development and evaluation, and AI-enabled application workflows.
  • Partner with AI/ML engineers to deliver data interfaces for inference workflows and capture model outputs, confidence scores, and user feedback for analysis and continuous improvement.
  • Implement data quality checks, reconciliation, pipeline monitoring, and alerting to ensure completeness, accuracy, freshness, and traceability.
  • Troubleshoot pipeline failures and performance issues; implement reliable retries, backfills, and incremental processing while optimizing compute and storage costs.
  • Collaborate with product managers, data scientists, analysts, and engineering partners to translate business requirements into practical data solutions.
  • Follow data security, privacy, access-control, and retention requirements when handling enterprise data and AI-generated outputs.
  • Write maintainable, tested code; participate in code reviews and CI/CD practices; document schemas, data lineage, dependencies, and operational runbooks.

Required Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, Engineering, Mathematics, Statistics, or a related quantitative discipline, or equivalent practical experience.
  • 3-5 years of relevant experience in data engineering or a closely related software engineering role.
  • Strong hands-on proficiency in Python and SQL, including complex queries, transformations, and troubleshooting.
  • Experience with Spark/PySpark and distributed data processing.
  • Experience building and supporting ETL/ELT pipelines on a cloud platform such as Azure or AWS.
  • Understanding of data modeling, relational databases, data lakes, data warehouses, and incremental processing patterns.
  • Experience with workflow orchestration tools such as Apache Airflow or Databricks Workflows.
  • Familiarity with event-driven or streaming data processing concepts, including event time, deduplication, and reliable delivery.
  • Experience with Git, automated testing, and production monitoring or troubleshooting.
  • Ability to independently deliver scoped work, communicate technical concepts clearly, and collaborate with technical and business stakeholders.

Preferred Qualifications

  • Hands-on experience with Databricks, Delta Lake, or lakehouse architectures.
  • Experience with Databricks Asset Bundles / Declarative Automation Bundles to define, version, and deploy Databricks jobs and pipelines across environments through CI/CD.
  • Experience with streaming technologies such as Kafka, Azure Event Hubs, or Spark Structured Streaming.
  • Experience with retail, customer, inventory, or operational datasets.
  • Experience preparing datasets for machine learning, anomaly detection, or AI model evaluation.
  • Familiarity with multimodal data, unstructured data processing, or time-based event correlation.
  • Exposure to edge-to-cloud data integration, containerized workloads, or infrastructure as code.

Pay rate: $60/hr. This is a 6-month contract position, onsite in Irving, TX. Candidates must be a Green Card holder, H4 EAD, L2 EAD, OPT, TN Visa, or US Citizen.

About Us

Peterson Technology Partners (PTP) is an Equal Opportunity Employer committed to creating a transparent, inclusive, and human-centered hiring experience.

For nearly three decades, PTP has operated as one of the top IT staffing and recruiting firms in the USA—built on trust, long-term partnerships, and technical excellence.

Based in the Chicago suburb of Park Ridge, IL, our team of more than 500 employees and consultants is dedicated to:

  • Helping every client make the best hiring decisions possible
  • Matching professionals with the right IT jobs and career opportunities

As part of that commitment, we believe in providing clear information about how our hiring technologies work and how your data is used. The following section outlines our AI-assisted interview process and your rights as a candidate.

AI-Assisted Interview Experience (Pete & Gabi – Rebecca):

To provide a consistent, fair, and flexible experience for all candidates, we use AI-assisted tools to support parts of the interview process. This includes our proprietary AI platform Pete & Gabi, which includes AI recruiter Rebecca.

These AI hiring tools help us:

  • Conduct recorded video interviews
  • Transcribe interviews
  • Summarize candidate responses
  • Generate job-related insights
  • Streamline communication and scheduling

Please note that:

  • The AI does NOT make hiring decisions; all decisions are made by our human recruiters, hiring managers, or client partners.
  • The AI does not evaluate facial expressions, emotions, or physical traits; it is used only to support fairness, consistency, and efficiency.

If you prefer a non-AI interview format, we will gladly provide an alternative.

Technical or Case Interviews (Role-Dependent): −

When applying for certain tech jobs, you may participate in:

  • A technical interview
  • A coding challenge
  • A case study
  • A client-specific assessment

We will always explain what to expect in advance so you can prepare with confidence.

Human Review & Selection: +

Every candidate’s profile—including interviews, conversations, and assessments—is reviewed by experienced recruiters and hiring leaders.

AI insights may assist with organization and evaluation, but final decisions are always human-driven.

Your Rights as a Candidate: +

At PTP, every candidate has the right to:

  • Request a non-AI interview path
  • Ask how your data is being used
  • Request access to transcripts or interview recordings
  • Request deletion of your AI-recorded interview
  • Receive clear, timely communication

Our goal is to ensure you feel respected, informed, and supported throughout your experience.

Our Commitment: +

For nearly three decades, PTP has focused on putting people first—candidates, consultants, employees, and clients.

We’re committed to a hiring process that is:

  • Transparent
  • Compliant
  • Equitable
  • Powered by innovative technology that enhances—not replaces—human judgment

Welcome to the future of hiring at Peterson Technology Partners.

We’re excited to learn more about you.

Equal Employment Opportunity: +

Peterson Technology Partners is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, national origin, gender identity, sexual orientation, disability, veteran status, or any other protected characteristic.

IT Staffing Firm - PTP