Location: Remote

Hiring Range:  This position hiring range is anticipated to be $90,000 to $110,000 annually, depending on experience.  

All staff in Information Technology Services – regardless of their unique position - are expected to perform their assigned duties in a manner consistent with professional standards, with full awareness of responsibilities toward managing personal and organizational data, with priority regard to delivering customer service, as leaders in learning and adapting to new technologies and in constructive and effective collaboration with colleagues.

Position Summary: The Cloud Data Engineer is responsible for building data pipelines that translate data from its raw form into curated data structures for use in data science, analysis, and visualization. This role is responsible for working with business and technical stakeholders from across the organization to ensure data is ingested from source systems, persisted in the data lake, and curated for downstream analytics purposes. This role also maintains existing solutions in our SQL data warehouse environment, to include databases and ETL processes.

Essential Duties/Responsibilities

• Use the AWS big data stack (S3, Glue, Python, etc) and third party tools (Snowflake, Matillion, Fivetran, Tableau) while following Best Friends’ best practices, policies, and standard operating procedures to design, code, test, document, and deploy data pipelines to ingest, transform, and curate raw source data into data useable for analytics.
• Ensure data pipelines have appropriate monitoring and alerting to guarantee data availability to downstream analytics processes.
• Recommend improvements to the information architecture of the data lake to ensure the security and findability of the information.
• Maintain expertise on current and future offerings from AWS, Snowflake, Matillion, Fivetran and others as it relates to data engineering. Make recommendations to improve and optimize data processing.
• Work with other IT and business teams to troubleshoot, determine root cause, troubleshoot, and solve operational issues.
• Maintain consistent project and standards documentation for data pipelines and development practices.
• Treat people around you with Kindness and Compassion, build trust by demonstrating authenticity and following through on your commitments, prioritize your well-being like you do our mission, and work to build strong relationships with your colleagues by participating in communication loops to share and receive honest feedback. You are responsible and accountable for the culture you add to your team dynamic.

Skills & Experience

• A minimum of 5 years of experience in data processing using a combination of SQL, NoSQL, and AWS data platforms.
• Understanding of and experience with traditional SQL data warehouses as well as modern cloud data lake platforms and technologies.
• Demonstrated ability designing and building data pipelines with the AWS serverless big data stack (S3, Glue, Python, Lambda, Athena, Cloud Formation)
• Experience with Snowflake and ETL/ELT pipeline tools (Fivetran, Matillion, etc) strongly preferred.
• Expertise in the Microsoft BI Stack, including: 
  • Experience in developing SSIS and SSDT packages in Visual Studio
  • Demonstrated ability designing and building ETL plans using MS SSIS
  • Experience with complex T-SQL queries and data relationships
• Ability to analyze user requirements and translate them into data models and pipelines according to specifications.
• Exceptional written and verbal communication skills and the ability to explain technology in non-technical terms.
• Exceptional analytical, conceptual, and problem-solving skills.
• Able to prioritize and execute tasks in a fluid and highly visible environment.
• Experience in the Tableau Desktop and Tableau Server BI environments a plus.
• Experience with Enterprise CRM environments and databases, preferably with Blackbaud CRM, a plus.
• A bachelor’s degree in computer science, information systems, computer engineering, or a related field or equivalent experience. 

Physical Requirements

• Able to work at a computer for extended periods of time with repetitive typing, arm and hand motion.
• Able to occasionally work outside of normal business hours for support and deployment activity.
• Able to participate in on-call rotation as necessary.