Senior Data engineer

  • Location
    New York, New York
  • Category:
    IT - IT
  • Job Type:
    Direct Hire
  • Job reference:
    US_EN_8_810010_2841843

You will work closely with other engineers to create skillfully designed data systems. If you believe in quality code, strong agile practices and powerful engineering culture, our client may be the best fit for you.

Responsibilities:

  • Develop and manage an exceptional data pipeline architecture.
  • Meet non-functional / functional business needs by putting complex and large data sets together.
  • Determine, create and carry out internal process enhancements: improving data delivery, re-creating infrastructure for better scalability, automating manual procedures, etc.
  • Make use of various data sources such as AWS, NoSQL and SQL technologies to build the required infrastructure for ELT/ETL.
  • Provide applicable insights into major business performance metrics, operational effectiveness and customer acquisition by building analytics tools that use the data pipeline.
  • Assist data scientist and analytics team members by creating data tools that will help them build and improve our product.
  • Aim for a greater data systems functionality by working with both analytics and data experts.
  • Experience:

  • MS or BS Degree in Information Systems, Computer Science, or another related field.
  • 5+ years work experience desirable, minimum of 3 years work experience required.
  • Familiarity with various databases like NoSQL, experience working with SQL and relational databases and solid working SQL knowledge.
  • Experience creating and enhancing big data sets, architectures and pipelines.
  • Solid analytic skills relevant to working with irregular data sets.
  • Strong working knowledge of highly scalable data stores, stream processing and message queuing. Experience with several data warehousing services like Snowflake and Redshift.
  • Datamart implementation and design.
  • Experience with Data and Model Governance.
  • Solid organizational skills.
  • Willingness to lead a remote team and experience working and supporting cross-functional teams in a dynamic workplace.
  • Technology Skills:

  • Highly proficient in Python including automated tests and object-oriented ideas.
  • Highly proficient in other programming languages.
  • Experience supporting or using cutting-edge Machine Learning services and libraries.
  • Experience using big data tools like Hive, Kafka, Spark, etc.
  • Experience using relational NoSQL and SQL databases including Cassandra and Postgres.
  • Experience using Workflow management tools like Airflow and data pipeline.
  • Experience using AWS cloud services such as Kinesis, EC2, Lambda, S3, Glue and Athena.
  • Experience using stream-processing systems: Spark-Streaming, Storm, etc.
  • Experience using container technologies like Kubernetes and Docker.
  • Experience using version control software like GitHub/Bitbucket.


  • Equal Opportunity Employer/Veterans/Disabled

    To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.parkerlynch.com/candidate-privacy

    The Company will consider qualified applicants with arrest and conviction records