3 months ago
Responsibilities
- Design and build large-scale distributed crawling bots and low-overhead infrastructure for adversarial environments.
- Develop and maintain pipelines that extract data from web pages, documents, PDFs, and APIs.
- Unify heterogeneous documents into coherent schemas across varied source formats.
- Preprocess and normalize raw data for classification, ML/NLP, and search indexing.
- Build APIs that expose structured and classified data through ElasticSearch/OpenSearch.
- Collaborate with ML/NLP teams to integrate classification models into pipelines.
- Automate workflows with Apache Airflow and deploy solutions on Kubernetes and AWS.
- Optimize and scale data pipelines with Spark and EMR for large datasets.
Requirements
- At least 4 years of Python experience building crawling or scraping solutions at scale.
- Experience working with REST APIs and processing PDFs using OCR, Tesseract, PyMuPDF, or similar tools.
- Proficiency with data processing, search technologies, and NoSQL or SQL databases.
- Experience with React.
- Ability to handle anti-scraping mechanisms and data-scaling challenges.
- Hands-on experience with AWS or GCP.
- Familiarity with NLP and machine learning is a plus.
- Experience with LLMs, NLP models, or ML frameworks such as Hugging Face, spaCy, TensorFlow, or PyTorch is preferred.
- Experience with automated document classification, high-scale production environments, petabyte-scale data, or Kubernetes is preferred.
Benefits
- Hybrid and remote work models are available based on proximity to office hubs.
- Travel is expected, including several fully supported team and company-wide offsites each year.
- Paid time off, paid maternity, parental bonding, and medical leave.
- Medical, dental, vision, and prescription coverage, with employee-only plans covering 100% of premiums and family coverage covering 50% of costs.
- Free confidential counseling through BetterHelp.
- 401(k) plan with a 100% employer match on contributions up to 6%.
- Flexible Spending Accounts and Health Savings Accounts.
- Life and AD&D insurance.
- Up to $60 per month toward fitness, mental health, or other wellness expenses.
- A $300 home office setup bonus after one year of employment.
- Continuing education support.
Tech Stack
Apache AirflowApache SparkAWSElasticsearchGoogle Cloud PlatformKubernetesPythonPyTorchReactspaCySQLTensorFlow
Categories
BackendData Engineering
About Tekmetric
Tekmetric is the all-in-one platform for auto repair shops. More than 15,000 shops nationwide trust Tekmetric to run smarter, get paid faster, and keep customers coming back. Shop management, integrated payments, built-in marketing, and real-time reporting work seamlessly. Shops run on one system, not five, which means more time is spent on cars, not software. Founded by a former shop owner, Tekmetric is built for every shop.