4 months ago
Responsibilities
- Build and design large-scale distributed crawling bots and infrastructure for adversarial environments with low operational overhead.
- Develop and maintain pipelines that extract data from web pages, documents, PDFs, OCR sources, and APIs.
- Unify heterogeneous documents into a coherent data schema across varied source formats.
- Preprocess and normalize raw data for classification, ML/NLP, and search indexing.
- Build APIs that expose structured and classified data through ElasticSearch/OpenSearch.
- Collaborate with ML/NLP teams to integrate classification models into data pipelines.
- Automate workflows with Apache Airflow and deploy solutions in Kubernetes on AWS.
- Optimize and scale data pipelines using Spark and EMR for large datasets.
Requirements
- At least 5 years of Python experience building crawling and scraping solutions at scale.
- Experience working with REST APIs, PDF processing, OCR, Tesseract, or PyMuPDF.
- Proficiency with data processing and search technologies, including ElasticSearch/OpenSearch and NoSQL or SQL databases.
- Hands-on experience with Airflow and Spark, EMR, or similar distributed systems.
- Experience handling anti-scraping mechanisms and data-scaling challenges.
- Hands-on experience with AWS or GCP.
- Familiarity with NLP and machine learning is preferred but not required.
- Experience with LLMs, NLP models, or ML frameworks such as Hugging Face, spaCy, TensorFlow, or PyTorch is preferred.
- Experience with automated document classification, high-scale production environments, petabytes of data, or Kubernetes is preferred.
Benefits
- Hybrid and remote work models are available based on proximity to office hubs.
- Travel and attendance at several team and company-wide offsites each year are expected and fully supported.
- Paid time off is provided.
- Paid maternity, parental bonding, and medical leave are provided.
- Medical, dental, vision, and prescription coverage are provided, with employee-only premiums fully covered and 50% of family costs covered.
- Free confidential counseling is available through BetterHelp.
- A 401(k) plan includes a 100% employer match on contributions up to 6%.
- Flexible Spending Accounts and Health Savings Accounts are available.
- Life and Accidental Death & Dismemberment Insurance are provided.
- Up to $60 per month is available for fitness, mental health, or wellness expenses.
- After one year of employment, employees receive a $300 home office setup bonus.
- Continuing education support is provided.
Tech Stack
Categories
BackendData Engineering
About Tekmetric
Tekmetric is the all-in-one platform for auto repair shops. More than 15,000 shops nationwide trust Tekmetric to run smarter, get paid faster, and keep customers coming back. Shop management, integrated payments, built-in marketing, and real-time reporting work seamlessly. Shops run on one system, not five, which means more time is spent on cars, not software. Founded by a former shop owner, Tekmetric is built for every shop.