Principal SE - Big Data Platform
Smartsheet
about 1 month ago
Bengaluru, India
Staff+
H1B Sponsor
Responsibilities
- Design and oversee the architecture of scalable and reliable data platforms.
- Develop and implement data models, ensuring data quality and governance.
- Build and optimize data pipelines for processing large datasets.
- Identify and resolve performance bottlenecks in data systems.
- Stay abreast of emerging data technologies for infrastructure innovation.
- Diagnose and resolve complex data-related issues.
- Implement data security measures and ensure compliance with governance policies.
Requirements
- Experience with enterprise SaaS software solutions that are highly available and scalable.
- Proficiency in handling large-scale structured and unstructured data.
- Experience in building and maintaining distributed data platform systems.
- In-depth experience in system design involving large petabytes of data.
- Familiarity with modern AI/data infrastructure patterns.
- Proficiency in AWS, GCP, Snowflake, and data pipeline frameworks.
- Strong programming skills in Python, SQL, and potentially Java or Scala.
- Knowledge of modern software engineering practices like Kubernetes and CI/CD.
- Ability to drive engineering excellence initiatives.
- Legally eligible to work in India and fluent in English.
Tech Stack
AirbyteApache AirflowAWSGoogle Cloud PlatformJavaKubernetesPythonScalaSnowflakeSQLTerraform
Categories
AI & MLData EngineeringData ScienceDevOps