Description:
As a talented Data Engineer with industry experience, you possess a proven track record in designing, developing, and maintaining data pipelines, large-scale systems, and infrastructure. Your collaborative nature drives you to work effectively with teams to ensure data is clean, accurate, consistent, and readily available for analysis. You are dedicated to empowering stakeholders to make informed decisions and optimize operations.
With an academic background in computer science or a related field, your interest in Machine Learning and Data Science is profound. Over the years, your career has spanned various roles, showcasing your understanding of the critical importance of well-managed projects.
You are eager to embrace responsibilities that foster professional growth and thrive in a collaborative work environment.
Responsibilities:
- Design and implement scalable and efficient data pipelines to process and analyze large volumes of data.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Build and optimize data models and databases for performance and reliability.
- Implement data quality processes to ensure data accuracy and integrity.
- Stay up-to-date with the latest technologies and best practices in data engineering and contribute to the continuous improvement of data infrastructure.
Profile Requirements
<aside>
⚙ Technical perspective:
- Proficiency in Python or other languages used in large-scale projects.
- Experience with technologies such as Dataflow, Airflow, BigQuery, DBT, Snowflake, Databricks, or similar.
- Hands-on experience with:
- Relational Databases (e.g., PostgreSQL, MySQL)
- Non-relational databases (e.g., DynamoDB, MongoDB, Vector DBS)
- Messaging services (e.g., Kafka, PubSub)
- Data Warehouses like BigQuery
- Orchestration tools like Airflow
- Frameworks for large-scale data processing (e.g., Apache Spark, Apache Beam)
- Familiarity with open-source tools (e.g., Linux, git, etc).
</aside>
<aside>
⚠️
Nice to have
- Knowledge of machine learning and data science concepts.
- Experience with Agile methodologies.
- Project Management experience, including leading teams and managing client expectations.
</aside>
Tryo-Benefits
We believe that great work happens when people feel inspired and challenged.
These are just a few things we offer to make this happen.
<aside>
🏋🏽♀️ Machine Learning meetups and training
</aside>
<aside>
🚀 Partnerships with top-notch clients in Silicon Valley
</aside>