Software Engineer II (Backend + Data pipelines)
Scribd
6 months ago
Atlanta, GA, USA +22 more
Mid Level / Senior
H1B Sponsor
Base Salary
$104k - $196k/yr
Responsibilities
- Design and build scalable systems to extract, enrich, and process metadata from millions of documents, images, and audio content.
- Leverage LLMs to integrate capabilities like summarization, classification, extraction, and enrichment into metadata pipelines.
- Collaborate with cross-functional teams, including ML engineers and product managers, to deliver scalable, efficient, and reliable metadata solutions.
- Optimize and refactor existing systems for performance, scalability, and reliability.
- Ensure data accuracy, integrity, and quality through automated validation and monitoring.
- Participate in code reviews, ensuring best practices are followed and maintaining high-quality standards in the codebase.
- Manage and maintain data pipelines, security, and infrastructure.
Requirements
- 5+ years of professional software engineering experience.
- Proficiency in Python, Scala, Ruby, or similar languages.
- Experience designing and building distributed systems at scale.
- Hands-on experience building, deploying, and optimizing solutions using ECS, EKS, or AWS Lambda.
- Experience with infrastructure-as-code tools like Terraform (or similar).
- Experience working with a public cloud provider (AWS, Azure, or Google Cloud).
- Familiarity with data processing frameworks like Spark or Databricks for large-scale workloads.
- Proven ability to test, profile, and optimize systems for performance, scalability, and reliability.
- Bachelor’s degree in Computer Science or equivalent professional experience.
- Bonus: Experience working with LLMs or integrating ML models into production systems.
Benefits
- 100% paid healthcare insurance coverage (Medical/Dental/Vision) for employees.
- 12 weeks paid parental leave.
- Short-term/long-term disability plans.
- 401k/RSP matching.
- Onboarding stipend for home office peripherals + accessories.
- Learning & Development allowance and programs.
- Quarterly stipend for Wellness, WiFi, etc.
- Mental Health support & resources.
- Free subscription to the Scribd Inc. suite of products.
- Referral Bonuses and Book Benefit.
- Sabbaticals and company-wide events.
- Team engagement budgets and flexible sick time.
- Volunteer Day and paid holidays (+ winter break).
- Access to AI Tools for productivity and innovation.
Tech Stack
Apache AirflowApache SparkAWSDatabricksDatadogPythonRuby on RailsScalaTerraform
Categories
AI & MLBackendData Engineering