Data Engineer

  • Location
    Chicago, Illinois
  • Category:
    IT - IT
  • Job Type:
    Direct Hire
  • Job reference:
    US_EN_8_800926_2833197

SUMMARY:

 

The Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. Experienced data pipeline builder and data wrangler that optimizes data systems and building them from the ground up. Supports our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

Responsibilities

ESSENTIAL DUTIES & RESPONSIBILITIES:

  • Creates and maintains optimal data pipeline architecture.
  • Assembles large, complex data sets that meet functional and non-functional business requirements.
  • Implements internal process improvements, automates manual processes, optimizes data delivery and re-designs infrastructure for greater scalability, etc.
  • Operates infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and relevant Azure technologies like Data Factory, Databricks, and similar.
  • Implement analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keeps our data separated and secure across national boundaries through multiple data centers and regions.
  • Builds data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Works with data and analytics experts to strive for greater functionality in our data systems.
  • Participating in special projects and performs other duties as assigned.
  • Qualifications

    MINIMUM EDUCATION & EXPERIENCE REQUIREMENTS:

  • Bachelor’s degree in Computer Science, Statistics, Informatics, Information Systems or a related field plus two (2) years minimum experience in a Data Engineering or similar business intelligence, data analytics or supply chain management role required.
  • MBA or Graduate degree in Computer Science, Statistics, Informatics, Information Systems or a related field in lieu of experience accepted.
  • KNOWLEDGE, SKILLS & ABILITIES REQUIREMENTS:

  • Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Working knowledge of Scala, Python or R.
  • Knowledge of building and optimizing data pipelines, architectures and data sets.
  • Ability to perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable data stores.
  • Strong project management and organizational skills.
  • Ability to support and work with cross-functional teams in a dynamic environment.


  • Equal Opportunity Employer/Veterans/Disabled

    To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.parkerlynch.com/candidate-privacy

    The Company will consider qualified applicants with arrest and conviction records