As a Senior Data Engineer, you’ll create and manage our data infrastructure and tools, including collecting, storing, processing and analyzing our data and data systems. You will work quickly and accurately, using the best solutions to process our data and make it easily accessible across the organization. The ability to automate the extraction, transformation, clean and combine disparate data sets is essential. In this role, you have the opportunity to own the architecture and data processes from end to end.
Collaborate with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
Work closely with product and engineering to develop strategy for long term data platform architecture
Align data pipeline, warehouse and analytics architecture with business requirements
Develop, construct, test and maintain data management systems using appropriate tools to perform data extraction, modeling, transformation, cleansing, loading, and interpretation
Integrate up-and-coming data management and software engineering technologies into existing data structures
Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
Define and catalog company data assets
Automate read, extract, transform, stage and load data processes using state of the art cloud based tools
Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues
Collected data from commercial databases, client databases, EMR systems, or other structured and unstructured sources
Collected Data must be ordered to allow for proper comparison, the data engineer must filter and "clean" the data to remove errors and ensure consistency and completeness of data
Cleansing routines should be used to identify like matches where data values may have been keyed incorrectly, may have partially matching strings or values may be missing
The Senior Data Engineer will need ETL tools as well as programming skills to write cleansing scripts to correct errors through automation
Data extracted and cleaned must be organized and stored in data warehouse or data lakes for easy access and analysis by team members
Work with the project team to define tasks and create team work plans with moderate supervision. Identify issues affecting work progress and recommends solutions
Communicate variances and potential scope changes in status reports
Control project costs, communicating any project-related expenses and recommend ways to control costs
Proven experience as a data engineer or in a similar role
Sound experience with schema design and dimensional data modeling
Solid SQL experience (No-SQL experience is a plus)
Proven of programming/scripting experience
Extensive experience designing, building, and maintaining data processing systems in a cloud architecture (AWS preferred)
Expertise regarding data models, database warehouse design and data ETL automation required
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
Telecommuting is allowed.
Internal Number: 5169
OpenArc is a technology consulting firm providing industry-leading technical talent placement, software development, and technology strategy services to clients nationwide. Through a unique blending of people and software, OpenArc has a business practice that delivers amazing enterprise, mobile and consumer-facing apps and the best talent for contract, contract-to-hire and direct placements for clients and partners alike.
Staffed with the most-trusted recruiting experts, elite software developers, UI/UX designers and market experts, our team provides clients with the best resources, the right techniques and world-class support resulting in powerful measurable success.