To Apply for this Job Click Here
Always Connecting, Always Evolving.
TECHEAD is seeking qualified applicants for the following Contract-To-Hire position – Data Engineer: IV (Lead) / Richmond VA – (JOB-22582). If you are looking for a new opportunity and this position looks to be a fit, please apply to see the TECHEAD difference that has made us successful for 30+ years!
You can find more about our team and values by checking us out at TECHEAD.com or on Glassdoor
Job Description:
Location: Remote (EST hours preferred; preference for candidates near Richmond, VA)
Position Type: Contract-to-Hire
Compensation: $70 – 75/hr
As a Senior Data Engineer on the Data Solutions and Engineering team, you will drive the transformation of core data capabilities using Databricks. You will focus on building enterprise frameworks, optimizing pipeline infrastructure, and implementing medallion architecture solutions. In this role, you will lead end-to-end SDLC processesfrom initial requirements to build, deployment, and supportwhile integrating advanced capabilities like AI-driven document processing to modernize legacy data structures.
Key Responsibilities
-
Framework & Capability Building: Enhance out-of-the-box Databricks features by building scalable frameworks, dashboards, and Delta table infrastructure (e.g., SLA data freshness tracking, data observability, pipeline monitoring).
-
Data Architecture & Engineering: Design and implement medallion architecture (Bronze, Silver, Gold layers) using ER and dimensional modeling to transform unstructured and legacy data into high-value assets.
-
AI & Document Processing: Leverage features like Intelligent Document Processing and AI extraction tools to parse images, PDFs, and unstructured records into structured analytical models.
-
Full SDLC Ownership: Collaborate with business users, architects, and technical leads to gather requirements, estimate work efforts, write code, run unit/SIT testing, and support UAT.
-
Enablement & Best Practices: Create clear documentation and training materials to help cross-functional and vendor teams (onshore/offshore) adopt your custom frameworks and Databricks best practices.
-
Governance & Security: Implement and maintain robust data security policies, Unity Catalog governance, and industry-standard compliance controls.
Technical Qualifications
-
Core Databricks Experience: 3+ years of full-time experience using Databricks (in Azure or AWS) leveraging medallion architecture, batch/streaming orchestration, and compute/storage optimization.
-
Languages & Querying: Expert-level proficiency in SQL and intermediate-to-advanced proficiency in PySpark.
-
Data Modeling: Demonstrated experience creating standardized dimension/fact tables, handling SCD Type 2 time tracking, and configuring ER models.
-
Pipeline Engineering: Proven track record building reusable coding frameworks for data standardization (e.g., missing values, date alignment, reference data management, data repair/imputation).
-
Tooling & DevOps: Strong background with Git/GitLab CI/CD, Lakeflow, data quality rules, Spark UI, and job scheduling.
-
Agile Proficiency: Comfortable operating in an Agile environment (defining technical tasks, writing user stories, and providing effort estimates).
TECHEAD’s mission is to make our on-site associates successful by placing them in the right environment so they can grow and prosper. How we treat and respond to our clients and employees is a reflection of who we are and makes us stand out from the rest. Keeping our business focused on building and maintaining relationships with our employees and clients is the key to our success. We won’t strive for anything less.
TECHEAD provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
For more information on TECHEAD please visit www.techead.com.
No second parties will be accepted.