Data Engineer

About The Company

Crunchbase is a leading provider of intelligence on private companies, leveraging live private company data, artificial intelligence, and market activity insights from over 80 million users worldwide. Our platform offers predictive solutions that help investors, dealmakers, and analysts understand private market movements and make informed decisions. Committed to fostering a positive, diverse, and inclusive culture, Crunchbase values transparency, openness, and potential. We believe that embracing diverse perspectives, backgrounds, experiences, and skill sets enhances our teams and enriches our products. As a remote-first organization, we prioritize flexibility, offering competitive pay, generous PTO policies, and comprehensive employee wellness benefits. Our commitment to innovation and inclusivity makes Crunchbase an ideal environment for professionals seeking growth and impact in the data-driven space.

About The Role

We are seeking a highly skilled Staff Data Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable and efficient data systems that empower our teams to develop data-driven products. You will work closely with cross-functional teams, including engineering, product, and analytics, to build robust data architectures that support advanced analytics, machine learning, and generative AI workloads. Your expertise will guide architectural decisions, optimize data pipelines, and ensure data quality and governance standards are upheld. This position offers an exciting opportunity to lead complex initiatives, innovate with emerging technologies, and mentor other engineers in a collaborative environment dedicated to continuous learning and technical excellence.

Qualifications

• Bachelor's or Master’s degree in Computer Science, Engineering, or a related field
• 6+ years of experience in data engineering with a focus on scalable data solutions
• Proficiency in Python and SQL
• Extensive experience with data pipelines, ETL processes, and data warehousing
• Hands-on experience developing end-to-end solutions in production environments
• Preferred: Experience with streaming data systems such as Kafka, and databases like Postgres, Elasticsearch, and Redis
• Proven leadership skills with the ability to mentor and guide team members
• Experience working with cloud platforms such as AWS, Azure, GCP, or Snowflake is advantageous
• Knowledge of containerization technologies like Docker and Kubernetes
• Experience with CI/CD practices and tools
• Familiarity with AI-assisted development tools such as Codex is a plus
• Curiosity and comfort in leveraging AI tools responsibly to enhance productivity while maintaining data privacy and accuracy

Responsibilities

• Design and evolve core components of the company's data platform, ensuring scalability and efficiency
• Lead complex data initiatives from conception to deployment, guiding architectural decisions
• Develop and optimize data structures and pipelines suited for analytics, machine learning, and AI workloads
• Collaborate with engineering, product, and analytics teams to facilitate seamless data integration and support decision-making processes
• Continuously improve data storage, processing, and retrieval performance, proactively diagnosing and resolving bottlenecks
• Stay current with emerging data technologies and evaluate new tools and approaches to enhance the data ecosystem
• Implement and maintain data quality checks and contribute to strong governance standards for trustworthy data management
• Mentor and coach other engineers, fostering a culture of collaboration, technical excellence, and continuous learning

Benefits

• Competitive compensation and equity packages that reward contributions and ownership
• Remote-first work environment with flexibility to work from home within approved states
• Comprehensive health benefits including medical, dental, and vision coverage (PPO, HDHP, HMO options)
• Generous professional development reimbursement to support ongoing learning and skills growth
• 401(k) and Roth retirement plans with annual financial advisory sessions
• Wellness resources, including a monthly stipend to support physical and mental health
• Home office setup allowance and internet stipend to enable effective remote work
• Charitable giving match through community impact initiatives and Town Hall awards
• Engagement with a mission-driven, transparent team of innovative thinkers and builders passionate about connecting and growing companies

Equal Opportunity

Crunchbase is committed to creating a diverse and inclusive environment. We do not discriminate on the basis of race, creed, color, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, height, weight, veteran status, military obligations, or marital status.