Дмитрий Ш.
Specializing in building, optimizing, and maintaining robust data pipelines to support data-driven decision-making across the organization. Key responsibilities and achievements: - Optimization of data processes, significantly reducing resource consumption and improving performance. - Development and support of data pipelines for internal and external clients, ensuring scalability and reliability. - Implementation of data processing scripts and management of high-load databases to ensure data integrity and availability. - Reverse engineering and setup of data collection from open and diverse web sources, with a focus on automation and efficiency. - Automation of workflows through custom tools and Jenkins jobs, streamlining recurring tasks and improving team productivity. - Design and deployment of reporting systems and custom data processes for analytics and cross-functional teams. - Collection and analysis of operational statistics to enhance system monitoring and performance evaluation. - Providing POCs related to clients requirements and needs. - Cost calculating and optimization in BigQuery prod storage for long-term clients. - Tooling & Automation: I enhance team productivity by refactoring legacy tools and building new internal automation solutions. - Duty L3 Engineering: Provide on-call support, ensuring high availability and rapid incident resolution for production data pipelines. - Mentorship and onboarding of new team members, as well as coordination of team efforts to meet project goals. - Participating in knowledge sharing meetings inside team and department.
Понравился профиль? Создайте себе такой же