Senior Data Engineer/Architect

Job Description

Senior Data Engineer/Architect

We are looking to add a senior individual contributor to the data science team. We leverage a forward thinking and progressive stack built in Scala and Python, with an infrastructure that uses Spark and Kafka. As a senior engineer, you will help scale up our next generation ETL pipeline. You will need to use and build tools to interact with our massive data set in as close to real-time as possible. If you have previous experience with functional programming and distributed data processing tools such as Spark and Hadoop, then you would make a great fit for this role!


Develop large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs Write ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytic processingBuild monitoring and alerting around the data pipeline for reliability and awareness on healthCollaborate with data science team to transform data and integrate algorithms and models into automated processes


5+ years of data engineering experience You have experience with distributed systems and working with large datasets using Spark a must and Hadoop, a plusPrevious experience scaling ETL pipelines 5+ years software architecture experience. Ideally, we need someone to have experience adding on to current architecture Experience configuring and maintaining continuous integration and automation tools (Jenkins or Hudson)Experience with test-driven developmentExperience mentoring a team of 4+ peopleExperience with functional programming in Scala 2 years experience with Python Experience using Kafka within an ETL pipelineStrong experience with SQL and Relational Databases (MySQL or PostgreSQL) Strong experience with non-relational data stores experience (i.e. Cassandra or Redis)Previous experience evaluating new technologies for continuous improvements in Data EngineeringStart up experience a plus Bachelors in computer science or equivalent industry experience, (graduate degree a plus)

Euclid Analytics connects the online and offline world for retailers and restaurants. Our product provides insights to help our customers reach, personalize and serve their customers. Through Wi-Fi-based solutions that illuminates in-store behavior, we support a single view of customers and precisely measure store influence. Euclid's growing network captures billions of interactions monthly across 65 countries and tens of thousands of locations, analyzing hundreds of millions of physical customer touch points yearly. Euclid is backed by leading venture capital firms Benchmark Capital and NEA, as well as Cox Enterprises and Groupe Arnault, the controlling shareholder of LVMH - Mo√ęt Hennessy Louis Vuitton, the world leader in luxury products.