Senior Data Engineer
Company: Insight Global
Location: Seattle
Posted on: May 4, 2024
|
|
Job Description:
Job Description
Disney Streaming is creating digital video entertainment products
for one of the largest media brands in the world, with the mission
of providing consumers the ability to access content on any
connected device, at any time, in any location. As we continue to
use our innovative technology to deliver dynamic direct-to-consumer
entertainment for millions of fans across the globe, we are looking
for a Lead Data Engineer, Data Platforms who can operate across the
enterprise to ensure on-time, high-quality delivery of products and
features that directly drive our business.
The Activation team within Data Platforms is responsible for
sharing data with internal customers and external 3rd party
partners in a secure and reliable fashion, ensuing that
"chain-of-custody" or our sensitive data is maintained at every
step of the process.
A Lead Data Engineer is responsible for creating tools and
platforms that enable this mission:
We are a company committed to creating diverse and inclusive
environments where people can bring their full, authentic selves to
work every day. We are an equal opportunity/affirmative action
employer that believes everyone matters. Qualified candidates will
receive consideration for employment regardless of their race,
color, ethnicity, religion, sex (including pregnancy), sexual
orientation, gender identity and expression, marital status,
national origin, ancestry, genetic factors, age, disability,
protected veteran status, military or uniformed service member
status, or any other status or characteristic protected by
applicable laws, regulations, and ordinances. If you need
assistance and/or a reasonable accommodation due to a disability
during the application or recruiting process, please send a request
to HR@insightglobal.com .
---------
To learn more about how we collect, keep, and process your private
information, please review Insight Global's Workforce Privacy
Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
*---Define, build, and execute process programs and communication
strategies in collaboration with cross-functional teams
*---Create and maintain documentation and templates for key
engineering processes
*---Assist enterprise-wide program roll-outs by developing training
documentation and runbooks
*---Drive initiatives related to engineering and program management
onboarding and process operations
*---Create and apply information architecture recommendations for
engineering and product teams
*---Drive continuous improvement on existing programs and
critically evaluate what is working well and what needs to be
improved
*---Design table structures and define ETL strategy to build
performant Data solutions that are reliable and scalable in a fast
growing data ecosystem.
*---Develop Data Quality checks for source and target data sets.
Develop UAT plans and conduct QA.
*---Develop and maintain ETL routines using ETL and orchestration
tools such as Airflow, Luigi and Jenkins.
*---10+ years of relevant Professional experience.
*---10+ years experience using analytic SQL, working with
traditional relational databases and/or distributed systems such as
Hadoop / Hive, BigQuery, Snowflake/Redshift.
*---10+ Years of experience programming languages (e.g. Python,
Java, Scala, bash) preferred.
*---Experience in Cluster Platform, especially EKS or Databricks
preferred.
*---2+ Experience in AWS Cloud Platform - AWS methodologies
*---2+ years of experience with workow management tools (Airow,
Oozie, Azkaban, UC4)
*---Good understanding of SQL Engines and able to conduct advanced
performance tuning
*---Strong communication skills -- written and verbal
presentations.
*---Excellent conceptual and analytical reasoning competencies.
*---Degree in an analytical field such as economics, mathematics,
or computer science is desired. null
We are a company committed to creating diverse and inclusive
environments where people can bring their full, authentic selves to
work every day. We are an equal employment opportunity/affirmative
action employer that believes everyone matters. Qualified
candidates will receive consideration for employment without regard
to race, color, ethnicity, religion,sex (including pregnancy),
sexual orientation, gender identity and expression, marital status,
national origin, ancestry, genetic factors, age, disability,
protected veteran status, military oruniformed service member
status, or any other status or characteristic protected by
applicable laws, regulations, andordinances. If you need assistance
and/or a reasonable accommodation due to a disability during the
application or the recruiting process, please send a request to
HR@insightglobal.com.
Keywords: Insight Global, Olympia , Senior Data Engineer, Engineering , Seattle, Washington
Click
here to apply!
|