about 4 hours ago
Bethesda, MD, USA or Waltham, MA, USA
Mid Level / Senior
H1B Sponsor
Base Salary
$112k - $176k/yr
Responsibilities
- Build and optimize big data pipelines to extract and process signals from various sources.
- Design and implement data architectures and storage solutions for massive data volumes.
- Collaborate closely with data scientists to integrate ML models into data workflows.
- Continuously improve data quality, performance, and scalability of the technographic data platform.
- Drive technical strategy and roadmap for data processing infrastructure.
Requirements
- Extensive experience building and scaling big data pipelines and architectures from scratch.
- Deep expertise in big data frameworks like Hadoop and Spark, and the JVM stack (Java, Scala).
- Strong software engineering fundamentals with the ability to write efficient, high-quality code.
- Experience with entity recognition and NLP techniques is a plus.
- Proven track record of delivering results in a fast-paced environment.
- Excellent collaboration and communication skills to work with cross-functional teams.
- Passion for leveraging large datasets to generate valuable insights.
- 5+ years of experience in software engineering roles.
- Experience with very large datasets and distributed systems.
- Familiarity with building data pipelines at large tech companies or data-driven organizations.
- Bachelor's or advanced degree in Computer Science, Engineering, or a related technical field.
Tech Stack
Apache HadoopApache SparkJavaScala
Categories
AI & MLData EngineeringData Science