Job Information
Insight Global Sr. Data Engineer in New York, New York
Job Description
Insight Global is seeking a Senior Data Engineer to join our client, a rapidly growing re/insurance organization modernizing their data ecosystem. This is role is on a high-performing data engineering team supporting core data architecture, data applications, and internal/external API data flows.
This engineer must be able to work independently, own end-to-end solutions, and operate with low oversight. The environment is highly collaborative, low-ego, and fully AI‑enabled—engineers are encouraged to leverage AI tools before escalating questions.
Day to Day will include:
Build, maintain, and optimize data pipelines that support applications, APIs, and reporting environments.
Migrate existing pipelines (currently using Click Replicate and proprietary solutions) into modern, open‑source–driven architectures.
Move and process data into the Snowflake data warehouse and manage CI/CD pipeline improvements.
Work with streaming and CDC concepts involving Kafka, Kafka Connect, Debezium (or similar tools).
Implement and manage transformations using DBT (SQL + configuration files).
Support medallion/layered data architecture (bronze, silver, gold), staging layers, and data marts.
Collaborate with backend architecture teams on data application development and API data flows.
Troubleshoot, refactor, and optimize data models and processing workflows.Use AI tools (e.g., Claude, Copilot) to accelerate problem-solving and development.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Skills and Requirements
- 5+ years expeirnece within data engineering
Strong SQL experience
Hands-on experience developing and supporting production data pipelines
Experience with or understanding of:
Kafka / Kafka Connect / CDC concepts (Debezium or similar)
-Snowflake or other cloud data warehousing platforms
-Medallion/layered data architecture principles
-CI/CD and modern data engineering workflows
- DBT experience (critical from day one) Python
PostgreSQL experience
Experience with Azure Blob Storage
Familiarity with lakehouse concepts (Databricks not required)
Broader cloud or infrastructure experience