Senior Data Engineer - New York City


: $94,330.00 - $148,460.00 /year *

Employment Type

: Full-Time


: Information Technology

As a Senior Data Engineer at Compass, you will be responsible for helping to build the data-driven decision-making culture throughout the organization. You'll work as part of a rapidly growing team in a fast-paced environment. You will be responsible for designing and managing large-scale analytical systems that impact multiple functions and teams across the organization. In this high impact role you will have an opportunity to work with emerging technologies, while driving analytical solutions end-to-end. You are someone who loves data and analytics, and strives to constantly learn the new and fast developing data technologies,

At Compass You Will:

* Design, develop, and implement the infrastructure that elevates data-driven decision-making for our proprietary real estate technology
* Work with the enterprise business systems that facilitate end to end experience of real estate transactions

This position is responsible for:

* Design and deliver flexible and scalable AWS Cloud solutions collecting process-level external and internal data and transforming it into enterprise wide data lake, denormalized data marts from which operational and process metrics and analytics can be reliably generated

What We're Looking For:

* Bachelor's degree in Computer Science, Information Systems, or related field
* Extensive experience with AWS platform
* 3+ years of experience building data lakes and data warehouses in AWS cloud utilizing s3, AWS Lambda, AWS Glue, Kinesis, EMR, Redshift, Data Pipeline, Athena, CloudWatch
* 10+ years of Data Warehousing experience, building ETL data pipes for populating dimensional marts,
* Working knowledge of Spark or other distributed processing engines
* Familiarity with API design patterns (oAuth, tokens, JSON)
* Experience with supporting Data Science and ML teams, experience supporting notebook environments for analytics/data science teams (Jupyter, Zeppelin, DataBricks)
* 5+ years of Python experience, and hands on experience with data analysis libraries like Pandas
* Good understanding of relational databases, Redshift preferred but Oracle, Postrgres or MySQL are ok too
* Familiarity with dimensional data modeling
* Familiarity with ETL tools like Informatica, Pentaho, Talend is a plus
* Experience with version control, scalable code deployment (Git, Jenkins)
* Comfortable in Linux environment
* Strong business communication skills
* Strong drive to constantly learn and keep up to speed with the new data technologies

At Compass, our mission is to help everyone find their place in the world. This means we continually celebrate the diverse community different individuals cultivate. As an equal opportunity employer, we stay true to our mission by ensuring that our place can be anyone's place.

Associated topics: data administrator, data architect, data center, data engineer, data integrity, data manager, data scientist, data warehouse, etl, hbase * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Create your profile now!

Create your Profile

Loading some great jobs for you...