Senior Data Engineer

Responsibilities

• Lead workspace architecture, Unity Catalog governance, and cluster policy design for client tenant organizations.
• Perform tenant discovery and requirements gathering, source profiling, and security classification for new data intake requests.
• Develop end-to-end technical designs for tenant onboarding, including Data Sharing Agreements and SLA documentation.
• Maintain Requirements Traceability Matrix (RTM) and prepare Architecture Review Board (ARB) submissions.
• Contribute to tenant onboarding automation, financial operations integration, and ROI reporting.
• Deliver tenant training materials and facilitate weekly office hours for client program teams.
• Support P1/P2 incident response within SLA for tenant-related platform issues.
• Provide NIST 800-53 control evidence within 5 business days of the client audit requests.

Required Skills and Qualifications

• Work Authorization: US Citizenship or Permanent Residency.
• Active Public Trust level clearance.
• Bachelor's degree in Computer Science, Information Technology, or related field.
• 8+ years in cloud data engineering; 3-5 years hands-on Databricks (Unity Catalog, Delta Live Tables, Auto Loader, Genie).
• Databricks Certified Data Engineer Professional or advanced equivalent.
• AWS Certified Solutions Architect or Data Engineer – Associate or Professional.
• Deep experience with medallion architecture (Bronze/Silver/Gold), Delta Lake, and CDC patterns.
• Proficiency in Python, PySpark, and SQL for enterprise pipeline development.
• Hands-on AWS: S3, IAM, VPC, CloudWatch, Glue, Athena.
• Experience with RBAC/ABAC, row-level security, PII column masking.
• Familiarity with FISMA, NIST 800-53, and FedRAMP High.