Job Description
As a Data Engineer at Q, you'll be entrusted with designing, building, and optimizing large-scale data pipelines in both on-premise and cloud environments. Your role will encompass the management and storage of binary and tabular data, integration and collaboration with our AI/ML teams and stable large scale ETL pipelines. We value agility, so staying updated and adaptable to our evolving tech stack is inherent to the role.
Responsibilities
- A solid experience with SQL and other databases
- Collaborating with the data team and stakeholders
- Manage and set up visualization tools
- Monitoring and logging frameworks such as Grafana, Prometheus, Kibana and Elastic
- Manage and design ETL processes, data cleansing, transformation, and integration
- Work closely with our ML/AI teams
- Proficiency in tools like Jenkins and Airflow
Requirements
- Bachelor's/Master's degree in Computer Science, Engineering or a related field
- 5+ years of proven experience as a Data Engineer or similar role in a startup or fast-paced environment
- Strong proficiency in Python
- Expertise in SQL and familiarity with other database systems
- Hands-on experience with data visualization tools
- Proficiency with monitoring and logging tools
- Experience with data flow and CI/CD frameworks
- Understanding of object storage solutions and best practices for binary data
- Excellent problem-solving skills, analytical mindset, and attention to detail
- Strong communication and collaboration skills
