This vacancy is now closed
$150,000 - $170,000 per year + benefits - Big Data & Data Science - New York
Ref: 258 Date Posted: Thursday 14 Jun 2018
LinkedIn ShareShare
More

My client is a New York based start-up who is focused on improving healthcare infrastructure with revolutionary technology. I am looking for a talented Senior Data Engineer to lead their ingestion pipeline and help automate their data platform.

You’ll join and work with a team of talented engineers who enjoy solving tough problems and improving the healthcare industry. My client believes in supporting both personal and professional growth. That means that they pay attention to goals, celebrate milestones and highly encourage learning opportunities.

Role and Responsibilities:

1) Assume ownership of the data ingestion and ETL pipeline. This means ensuring that data is being munged and ingested correctly, capturing exceptions, implementing a system to notify stakeholders when those exceptions occur, and instrumenting all elements of the pipeline stack. You will also iterate on their current architecture to make it more efficient and fault tolerant. The goal for my client is to have a pipeline that can ingest new data from any source with minimal reconfiguration.

2) Maintain concurrency between their services and their data warehouse, and work with the data scientist to provide engineering support for their machine-learning engine. This will allow them to match providers to their credential records.

3) Build tools to facilitate on-boarding their customers’ data and enable their operations team to change and view that data. You’ll be the point of contact for the operations team when there are technical requests that specifically impact the data pipeline.

As the platform grows, so too does the need for a high-performance ETL pipeline and a scalable framework for storing that data and making it accessible for the customers and operations team. 

Requirements:

•             3-5 years professional software development experience

  • Experience building and maintaining robust Python data infrastructure
  • Outstanding coding skills and knowledge of patterns and best practices in software engineering
  • Working knowledge and opinions of latest tools for data collection, analysis, warehousing and transformation
  • Good, open communicator. Your code/scripts should not be the only thing that speaks for your work. 
  • Familiarity with Docker, Postgres, AWS, and Kafka is ideal 

Perks:

  • Extremely competitive compensation with equity options and benefits
  • Based in Manhattan – Flexible working available (everyone works from home one day per week)
  • Fantastic leadership team – Truly supportive and lead by example 

At this time my client can take applications from US Citizens and Green Card Holders. 

James Hodges looks after this role for KDR, if you have a question get in touch...



Apply now

Where should we send our newsletter?

Close