The Lead Data Technologist designs and implements cutting-edge technical data solutions that drive high business value as part of the Cloud Data Platform. The successful candidate is unafraid to challenge technical constraints and procedures to achieve an Agile design. As a lead you will work closely with all team members to create a modular, scalable solution that addresses current needs, but will also serve as a foundation for future success. The Lead will be critical in building the team’s engineering practices in test driven development, continuous integration, automated deployment and is a hands-on team member who actively coaches the team to solve complex problems. She / he will be responsible for the design, development, performance and support of the Cloud Platform components. The role will report to the Data Engineering Leader.
Be a critical member of Agile team to design, build and support the Cloud Data Platform that meets performance, scalability, reliability, and security needs.
Provide proactive technical oversight and mentorship to development teams fostering re-use, design for scale, stability, and operational efficiency based on strategic business needs
Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Be hands on and engage in coding to help the team develop the solution and solve all surfaced problems
Designs complex solutions and leads them from inception to production within the agile team.
Responsible for working with data asset-related technology that has been approved by the architecture organization to move, transform, and validate data between systems and Azure Cloud.
Ability to create designs following established data integration patterns and establish new patterns to meet business needs
Provide data integration subject matter expertise to the team covering ETL/ELT, replication, streaming, and virtualization. Can explain complex concepts to others and establish business value of solutions
Complete design, code review and test case reviews to improve and set the bar for the quality of the delivery. Providing guidance for the engineering team while designing the data integration applications
Maintain ETL/Data integration agile management stories with delivery to dates to ensure Agile processes are adhered to.
Contribute to a positive culture of continuous improvement and operational excellence by identifying and implementing process improvements where appropriate.
Collaborate with architects, business users, system analysts, developers, and ecosystem partners to bring innovative ideas from conception to launch at scale
Work in an iterative/Agile environment and be a strong team player
Adopt emerging technologies and launch products / services faster with rapid prototyping & iterative methods
Proven ability to take prototypes to production, following engineering best practices
Experience in data engineering or related field
In-depth knowledge of database structures/ data warehousing principles, and experience in SQL across different platforms including structured and unstructured data from various enterprise sources
Understand batch and real-time data integration patterns include ETL experience (Informatica, SSIS, Azure Data Factory etc), data replication, data streaming, virtualization, etc
Experience in writing and executing complex SQL’s.
Proven technical skills in data modeling, data management, data pipelines, ETL/ELT and data retention concepts and practices.
Extensive hands-on experience implementing data migration and data processing using Azure services:, Serverless Architecture, Azure Storage, Azure SQL DB/DW, Data Factory, Azure Stream Analytics, Synapse Analytics, HDInsight, Databricks, Cosmos DB, ML Studio, AI/ML, Azure Functions, ARM Templates, Azure DevOps, CI/CD etc.
Extensive knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores and experience with building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience in end to end data engineering solutions
Show a strong sense of ownership for their deliverables
Initiative and passion for finding solutions to ambiguous problems and ability to work in difficult situations and across organizational boundaries.
Strong communication skills both written and verbal, with ability to communicate or convey the results to audience at all levels.
Familiar with the latest technologies, trends, standards, products, and applicability
Ability to effectively adapt to rapid technological and business change while maintaining enthusiasm and displaying sound judgment
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
Internal Number: 5526
OpenArc is a technology consulting firm providing industry-leading technical talent placement, software development, and technology strategy services to clients nationwide. Through a unique blending of people and software, OpenArc has a business practice that delivers amazing enterprise, mobile and consumer-facing apps and the best talent for contract, contract-to-hire and direct placements for clients and partners alike.
Staffed with the most-trusted recruiting experts, elite software developers, UI/UX designers and market experts, our team provides clients with the best resources, the right techniques and world-class support resulting in powerful measurable success.