Mar 2017 - Present
Manager Data ServicesAvant Inc — Chicago IL
- Led 8 Person Data Services team responsible for all Data Engineering company wide..
- Transitioned traditional Data Warehouse to 100% Open Source Data Lake running on Hadoop, Presto, Spark & AWS.
- Integrated Streaming, Presto and related technologies with customer facing web applications.
- Interfaced modern Hadoop architecture with legacy COBOL Mainframe credit card processing infrastructure
Jun 2016 - Mar 2017
Principal ArchitectNielsen Marketing Analytics — Evanston IL
- Acted as architect for next-generation analytics platform for all Buy related business divisions.
- Worked across the organization on the development of a shared enterprise data model
- Led team dedicated to making the Data Lake and related big data technologies available to analysts in an accessible way
- Managed migration of existing analytics workflows from C# & SAS to Python, R, Scala, Java & Spark.
Mar 2015 - Jun 2016
Sr. Data EngineerNielsen Marketing Analytics — Evanston IL
- Led Development of next generation Multi-Touch Attribution product on Spark / Python.
- Worked closely with combined development & analysis teams to transition legacy models from SAS / C# to Spark, Scala & Python.
Jun 2012 - Feb 2015
Data Science DeveloperCognitive Capital — Chicago IL
- Implemented Hadoop Infrastructure.
- Migrated trading system trade & performance analysis from ad hoc sampling script to nightly analysis of all messages via MapReduce.
- Leveraged MongoDB to create firm wide analysis and reporting cache to support Quant workflows.
- Built next-generation tick data store using Parquet / Impala
- Created content managements system for interactive visualisations and the simplified creation of reports Led Deployment of Spark to enable quant workloads on Hadoop.
University of Rochester