Search Jobs
Jobs filters
DATABRICKS PLATFORM ARCHITECT
New York, NYCompany Description
Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.
Job Description
Publicis Sapient is looking for a Manager Data Engineering, Databricks Platform Architecture, a top-notch technologist who will lead build of global Databricks Platforms to enable real business outcomes for our enterprise clients. You will create impact for some of the world’s biggest brands, by translating their needs into transformative solutions that provide valuable insight. Working with the latest data technologies in the industry, you will be instrumental in helping our clients evolve for a more digital future.
Your Impact:
- Act as a Databricks global platform lead as part of large digital transformation journeys
- Advance the application of Databricks data platforms as a core building block to enable true business transformation
- Lead Data Migration and Data Modernization projects to Databricks
- Build complex data ingestion, processing and consumption storage and pipelines on Databricks
- Work closely with our clients in understanding their needs and translating them to technology solutions
- Provide expertise as a technical resource to solve complex business issues that translate into data integration and Databricks systems designs
- Shape opportunities and create execution approaches throughout the lifecycle of client engagements
- Ensuring all deliverables are of high quality by setting development standards, adhering to the standards, and participating in code reviews
- Mentor, support, and manage team members
Qualifications
Your Skills and Experience:
- Databricks Architecture: Deep understanding of Databricks architecture, including clusters, notebooks, jobs, and the underlying compute and storage layers. Architect level who has also done hands work on Databricks in the past 5+
- Databricks Platform: Experience building Databricks as a global platform (across multiple regions) which supports an organizations multiple Lines of Business (LOB)
- Apache Spark: Proficiency in Apache Spark, including its core components (Spark SQL, Spark Streaming, and MLlib).
- Delta Lake: Knowledge of Delta Lake, its features (ACID transactions, time travel, etc.), and its role in data lakes and data warehouses.
- Databricks SQL: Experience in using Databricks SQL for data querying, analysis, and visualization.
- Databricks Jobs: Ability to create and manage complex data pipelines and workflows using Databricks Jobs.
- Cluster Management: Understanding of cluster configurations, autoscaling, and performance optimization.
- Unity Catalog experience required
- Infrastructure & Security: Deep understanding of AWS or Azure cloud essentials – Storage, Networking, Identity and Access Management and above all Network and Data Security, handling sensitive data and data compliance with GDRR, CCPA etc
- Networking: Understanding of network configurations, VPCs, and security groups for Databricks deployments.
- Cost Optimization: Ability to analyze and optimize Databricks costs by leveraging features like spot instances, cluster policies, and auto-termination.
- Infrastructure & Terraform: Infrastructure experience required and familiarity with Terraform scripts
Set Yourself Apart With:
- Certifications for any of the cloud services like Azure, AWS, or GCP
- Certifications for any Machine Learning/Advanced Analytics Courses
- Experience working with code repositories and continuous integration pipelines using AWS code build/code pipelines or similar tools/technologies
- Experience in data governance and lineage implementation
- Multi-geo and distributed delivery experience in large programs
Additional Information
Pay Range: $117,000-210,000
The range shown represents a grouping of relevant ranges currently in use at Publicis Sapient. Actual range for this position may differ, depending on location and specific skillset required for the work itself.
Benefits of Working Here:
- Flexible vacation policy; time is not limited, allocated, or accrued
- 16 paid holidays throughout the year
- Generous parental leave and new parent transition program
- Tuition reimbursement
- Corporate gift matching program
As part of our dedication to an inclusive and diverse workforce, Publicis Sapient is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at hiring@publicissapient.com or you may call us at +1-617-621-0200.