Data Engineer
Περιγραφή εργασίας
We are looking for a Data Engineer to support the development and maintenance of the company’s data infrastructure and data pipelines. The successful candidate will be responsible for collecting, transforming, validating, and maintaining data from multiple external and internal sources to support reporting, analytics, and business intelligence initiatives.
This role requires strong technical expertise in Python, SQL, AWS services, and data warehousing, with a focus on ensuring data accuracy, reliability, and scalability across the organization.
Key Responsibilities
Data Collection & Integration
• Develop, maintain, and optimize Python-based data extraction and web scraping solutions.
• Collect data from websites, APIs, social media platforms, and third-party sources.
• Monitor and troubleshoot data extraction processes to ensure continuity and reliability.
• Integrate structured and unstructured data into internal systems and databases.
Data Pipeline & ETL Management
• Configure, maintain, and monitor ETL/ELT pipelines using AWS services such as Glue, Lambda, S3, and Redshift.
• Ensure smooth data movement between source systems, data lakes, and data warehouses.
• Optimize SQL queries and data transformation processes for performance and scalability.
• Support automation of recurring data workflows and ingestion processes.
Data Warehouse Maintenance
• Support the administration and maintenance of Amazon Redshift environments.
• Create and maintain database tables, schemas, and data models.
• Assist with performance optimization and query tuning.
• Ensure data is organized and accessible for reporting and analytics purposes.
Data Quality & Validation
• Perform regular data validation and quality assurance checks.
• Identify, troubleshoot, and resolve issues related to incomplete, inconsistent, or inaccurate data.
• Develop automated monitoring and validation scripts to improve data integrity.
• Collaborate with internal stakeholders to ensure reporting accuracy and consistency.
Collaboration & Documentation
• Work closely with Data, Product, Marketing, and Business teams to understand data requirements.
• Maintain technical documentation related to pipelines, integrations, and database structures.
• Follow version control and development best practices using Git/GitHub.
Requirements
Qualifications & Experience
- Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
- 2+ years of experience in Data Engineering, ETL development, or related roles.
- Experience working with large datasets and cloud-based data environments.
- Strong analytical and problem-solving skills.
- Ability to work independently and collaboratively in a fast-paced environment.
Preferred Qualifications
- Experience with BI/reporting tools.
- Familiarity with automation and workflow orchestration tools.
- Experience working with marketing and social media platform integrations.
- Understanding of data governance and data security best practices.
Skills
- Advanced proficiency in Python, including experience with:
- Scrapy
- BeautifulSoup
- Selenium
- Strong SQL skills and experience optimising complex queries.
- Hands-on experience with AWS services including:
- Amazon Redshift
- AWS Glue
- Amazon S3
- AWS Lambda
- Experience working with and OAuth authentication
- Understanding of data warehousing concepts and data modelling methodologies (Star/Snowflake schemas)
- Experience using Git/GitHub for version control.
Benefits
- Annual Discretionary Bonus
- 21 Days Annual Leave
- Health & Dental Coverage
- 5 Paid Sick Days
- Flexible Working Hours
- Hybrid working model (2 days per week working from home)
- Early Out on Fridays
- Long Weekend Leave
Maternity & Paternity Top-Up Allowance - Complimentary Lunch at the office
- Company Laptop provided
Πώς να υποβάλετε αίτηση
Οι ενδιαφερόμενοι υποψήφιοι παρακαλούνται να στείλουν το βιογραφικό τους στον Διευθυντή Ανθρώπινου Δυναμικού στο grouphr@ultimate.group.